Information processing apparatus, information processing system, and application

Abstract

To provide an information processing apparatus configured to motivate a user to walk.SOLUTION: A management computer 11 includes a processor 14. The processor 14 performs: a first process to determine whether a start position where a user 21 starts to move has been selected and whether a destination apart from the start position has been selected through a user terminal 13; a second process to permit, when it is determined that the start position and the destination have been selected through the user terminal 13, the user terminal 13 to perform connection processing to connect a plurality of images including images related to a route from the start position and the destination, from a point of time at which the user 21 starts moving from the start position to the time of an arrival at the destination; and a third process to prohibit, when it is determined that the start position and the destination position have not been selected through the user terminal 13, the connection processing from being performed on the user terminal 13.SELECTED DRAWING: Figure 1A

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, an information processing system, and an application that combine and use a plurality of images. [Background technology]

[0002] Non-Patent Document 1 discloses an example of an information processing device, information processing system, and application that combines and utilizes multiple images. Non-Patent Document 1 discloses that "MemoryGraph (Memogra) is a camera app that supports taking photos with the same composition. Enjoy photography that visualizes changes, such as photos of then and now, before and after photos, fixed-point observation photos, and pilgrimage photos." Non-Patent Document 1 also discloses that "MemoryGraph is similar to but not the same as augmented reality (AR). Photos are overlaid on the camera viewfinder, not in the landscape."

[0003] Furthermore, Patent Document 1 describes a visual inspection method. The visual inspection method described in Patent Document 1 is characterized in that "a transparent organic EL display is installed in a window of a moving body facing the inside of the moving body, a camera is installed near the window of the moving body facing the outside of the moving body, and images previously captured and saved by the camera are displayed on the transparent organic display, allowing a person on board the moving body to see the scenery visible in real time from the window of the moving body superimposed on the image displayed on the transparent organic EL display." [Prior art documents] [Non-patent literature]

[0004] [Non-Patent Document 1] ROIS-DS Humanities Open Data Joint Use Center, Memory Graph, [Retrieved May 15, 2024], Internet<URL:https: / / mp.ex.nii.ac.jp / > [Patent documents]

[0005] [Patent Document 1] Japanese Patent Publication No. 2023-027866 Summary of the Invention [Problem to be solved by the invention]

[0006] The inventors of the present application have recognized that the techniques described in Patent Documents 1 and 2 still have room for improvement in terms of increasing the user's motivation to walk.

[0007] An object of the present disclosure is to provide an information processing device, an information processing system, and an application that can further increase a user's motivation to walk. [Means for solving the problem]

[0008] This embodiment describes an information processing device that has a processor that executes processing and is communicatively connected to a user terminal via a network, wherein the processor processes information obtained from the user terminal to execute a first process of determining whether a start position from which the user holding the user terminal will begin movement has been selected on the user terminal before the user moves on Earth, and whether a destination away from the start position has been selected on the user terminal; a second process of allowing the user terminal to perform a combining process of combining multiple images, including images related to the movement path from the start position to the destination, on the user terminal from the time the user starts moving from the start position to after the user reaches the destination, when it is determined that the start position and the destination have been selected on the user terminal; and a third process of prohibiting the combining process from being performed on the user terminal when it is determined that the start position and the destination have not been selected on the user terminal. [Effects of the Invention]

[0009] According to this embodiment, it is possible to further increase the motivation of the user to walk. [Brief explanation of the drawings]

[0010] [Figure 1A] FIG. 1 is a conceptual diagram illustrating an example of the configuration of an information management system. [Figure 1B] FIG. 2 is a conceptual diagram illustrating an example of the configuration of a management computer included in the information management system. [Figure 1C] FIG. 2 is a conceptual diagram showing an example of the configuration of a user terminal included in the information management system. [Figure 2] 10 is a flowchart illustrating an example of processing performed in an information management system. [Figure 3] FIG. 10 is a conceptual diagram illustrating an example of an activity screen displayed on a display unit of a user terminal. [Figure 4] FIG. 10 is a conceptual diagram illustrating an example of a shooting screen displayed on a display unit of a user terminal. [Figure 5] FIG. 10 is a conceptual diagram showing an example of a screen displayed on a display unit of a user terminal. [Figure 6] FIG. 10 is a conceptual diagram showing an example of a screen displayed on a display unit of a user terminal. [Figure 7] 10 is a flowchart illustrating an example of a subroutine executed by the management computer. DETAILED DESCRIPTION OF THE INVENTION

[0011] (overview) In this embodiment, an information processing system 10 shown in FIG. 1A is disclosed. The information processing system 10 shown in FIG. 1A includes a management computer 11, a user terminal 13 connected to the management computer 11 via a network 12, and goggles 56. The management computer 11 is managed and operated by an administrator 20, for example, a company or an individual. The user terminal 13 is operated and used by a user 21. The user 21 may be an individual, a company, an organization, or the like.

[0012] 1A shows a single user terminal 13, multiple user terminals 13 can be connected to management computer 11 via network 12. That is, user terminals 13 include user terminal 13A used by user 21A and user terminal 13B used by user 21B. User 21B includes a service provider that provides user 21A with services related to the hobbies of user 21A.

[0013] Services related to the hobby of user 21A are, for example, the following services: If user 21A's hobby is art appreciation, the service provider includes an art museum manager. If user 21A's hobby is shogi or go, the service provider includes a go club or shogi club manager. If user 21A's hobby is running, the service provider includes a running facility manager. If user 21A's hobby is watching movies, the service provider includes a movie theater manager.

[0014] User 21A and user 21B are different people. There may be three or more users 21, and there may be three or more user terminals 13. In this embodiment, several specific examples of the management computer 11 are disclosed, several specific examples of the user terminal 13 are disclosed, and several specific examples of the application are disclosed.

[0015] (Administrative computer) 1B is a computer equipped with a main body (casing), processor 14, main memory 15, auxiliary memory 16, communication interface 17, etc. Processor 14 is provided inside the main body and is composed of a central processing unit (CPU (Central Processing Unit)) that integrates an arithmetic unit (arithmetic circuit) and a control unit (control circuit). Processor 14 is communicatively connected to main memory 15, auxiliary memory 16, and communication interface 17 via bus 18.

[0016] By executing applications, the processor 14 comprehensively controls other devices and circuits provided inside the main body and devices and circuits provided outside the main body. By executing applications, the processor 14 processes information obtained from the auxiliary memory 16 and information obtained from the user terminal 13. The processing performed by the processor 14 includes calculation, judgment, comparison, control, etc. The processing performed by the processor 14 includes adding, changing, updating, etc. of information stored in the auxiliary memory 16. Non-transient applications executed by the processor 14 include those stored in the auxiliary memory 16 and those obtained from external devices 19 via the network 12. The external devices 19 include communication bases, various computers, etc.

[0017] The information processed by the processor 14 includes data, images, map information, user information, user 21 activity information, etc. Images include photographs, still images, videos, illustrations, animations, etc. Map information is a diagram that represents part or all of the Earth using symbols and characters, reduced or distorted. Map information may be either two-dimensional or three-dimensional, and the characters may be in any language of the world. The language can also be changed as desired. Furthermore, map information includes auxiliary information such as the history, buildings, products, and events of each country, region, and location, as well as the longitude and latitude of each location.

[0018] The user information is information about the user 21 who uses the application. The user information includes, for example, the user 21's name, date of birth, gender, address, email address, hobbies, preferences, interests, countries they would like to visit, cities and regions they would like to visit, password, fee plan, phone number, etc. The activity information and fee plan of the user 21 will be described later.

[0019] The main memory 15 is a volatile storage device that functions as a work area and a buffer area when the processor 14 executes processing. The auxiliary memory 16 is a non-volatile, i.e., non-transient, storage device that stores non-transient applications. The auxiliary memory 16 has a larger capacity than the main memory 15 and operates in response to input and output commands from the processor 14.

[0020] Auxiliary memory 16 includes, for example, magnetic disks, optical disks, flash memory, etc. Examples of magnetic disks include hard disk drives, and examples of optical disks include compact discs, digital video discs, and Blu-ray discs. Flash memory is a type of semiconductor memory, and examples of flash memory include SD memory cards, USB flash drives, and solid-state drives. At least one element included in auxiliary memory 16 can be understood as non-transitory storage medium 16A that stores non-transitory applications and various information and is computer-readable.

[0021] The auxiliary memory 16 stores applications executed by the processor 14, information before being processed by the processor 14, information resulting from processing by the processor 14, information used for processing, judgment, machine learning, automatic generation, etc. of the artificial intelligence unit 28, learning data, etc. The information before being processed by the processor 14 and the information resulting from processing by the processor 14 include images, map information, user information, user activity information, etc. Images include photographs, still images, videos, illustrations, animations, etc.

[0022] The communication interface 17 includes devices, equipment, and standards that connect the management computer 11 to the network 12 via at least one of a wireless communication system and a wired communication system. Devices and equipment that connect the management computer 11 to the network 12 include cables, antennas, routers, etc. The network 12 includes an internetwork, a personal area network, a local area network, a campus area network, etc. The management computer 11 obtains information sent from the user terminal 13 and external devices 19 via the communication interface 17. The management computer 11 transmits information to be sent to the user terminal 13 and external devices 19 via the communication interface 17.

[0023] By loading and executing non-transient applications, the processor 14 is configured to function as a website management unit 22, a user information processing unit 23, an acquired information processing unit 24, a provided information processing unit 25, a map information processing unit 26, a determination unit 27, an artificial intelligence unit 28, and a reward processing unit 29. The website management unit 22 manages websites published on the network 12, information on services provided on the websites, usage screens provided to the user terminal 13, etc.

[0024] The user information processing unit 23 processes and manages user information acquired from the user terminal 13, manages accounts assigned to each user 21, stores the results of processing the user information in the auxiliary memory 16, manages and updates the history of the user information stored in the auxiliary memory 16, processes and manages activity information of the user 21 acquired from the user terminal 13, etc. The user information processing unit 23 also realizes an environment in which the user terminal 13A and the user terminal 13B can converse with each other and share information with each other.

[0025] The acquired information processing unit 24 processes various types of information acquired from the user terminal 13 and the external device 19, and stores the processing results in the auxiliary memory 16. The various types of information processed by the acquired information processing unit 24 may include some or all of the user information, or some or all of the activity information of the user 21. The various types of information processed by the acquired information processing unit 24 include audio information, image information, etc. The provided information processing unit 25 executes processing to provide the various types of information processed by the processor 14 and the information stored in the auxiliary memory 16 to the user terminal 13 and the external device 19.

[0026] In addition, the provided information processing unit 25 has the function of generating, based on the starting position, destination, user information, and information stored in the auxiliary memory 16, information on the travel route from the starting position to the destination and notable facilities in the surrounding area, information on events and history, the location and number of checkpoints on the travel route, quizzes that the user 21 is likely to be interested in, quizzes related to the travel route from the starting position to the destination, etc.

[0027] The map information processing unit 26 manages the map information stored in the auxiliary memory 16, updates the map information in the auxiliary memory 16 based on information obtained from the external device 19, processes the map information to be provided to the user terminal 13, and so on.

[0028] The reward processing unit 29 sets a reward to be given to the user terminal 13 based on the activity information of the user 21. The reward includes crypto assets (virtual currency), points, etc. The activity information of the user 21 includes, for example, the number of times the user 21 reaches a destination, the number of steps taken by the user 21, the distance traveled by the user 21, whether or not the user 21 has answered a quiz, the percentage of correct answers to the quiz, etc.

[0029] The reward processing unit 29 sets relatively more points to be awarded as the number of times the user 21 reaches the destination increases. The reward processing unit 29 sets relatively more points to be awarded as the number of steps taken by the user 21 increases. The reward processing unit 29 sets relatively more points to be awarded as the distance traveled by the user 21 increases. The reward processing unit 29 awards points when a quiz is answered, and does not award points when the quiz is not answered. The reward processing unit 29 sets relatively more points to be awarded as the rate of correct answers to the quiz is relatively higher. The determination unit 27 executes a process of determining whether the user 21 has reached the destination, a process of storing the determination result in the auxiliary memory 16, and a process of sending the determination result to the user terminal 13.

[0030] The artificial intelligence unit 28 has the function of creating history data and update data for the various information stored in the auxiliary memory 16 based on the various information acquired by the management computer 11, the various information stored in the auxiliary memory 16, and learning data, and storing the created data in the auxiliary memory 16. In addition, the artificial intelligence unit 28 automatically generates various information to be proposed to the user terminal 13 based on the user information and activity information of the user 21, and stores it in the auxiliary memory 16.

[0031] The artificial intelligence unit 28 is an artificial intelligence (AI) that includes transformers including GPT (Generative Pre-trained Transformer), BERT (Bidirectional Encoder Representations from Transformers), etc., and language models such as recurrent neural networks, and is capable of performing processing as generative artificial intelligence.

[0032] The language model is an example of a learning model based on a machine learning algorithm. Specific examples of machine learning algorithms include nearest neighbor methods, naive Bayes methods, decision trees, support vector machines, and deep learning using neural networks. The artificial intelligence unit 28 can apply the above algorithms as appropriate.

[0033] The artificial intelligence unit 28 may also have a trained model constructed by a learning method such as supervised learning, unsupervised learning, or self-supervised learning. In supervised learning, machine learning is performed using training data including training data. The training data is composed of pairs of input data for learning and output data including correct answer data. The language models include those trained for specific tasks and general-purpose models that can be used for a wide range of tasks.

[0034] The artificial intelligence unit 28 has a function of automatically generating a trained model by performing machine learning, for example, deep learning using a neural network, based on various information and data stored in the auxiliary memory 16 and information and data newly acquired from the user terminal 13 and external devices 19. The automatically generated trained model is stored in the auxiliary memory 16. The artificial intelligence unit 28 has a function of automatically extracting an image of the route from the current location to the destination based on map information and information acquired from the user terminal 13. The artificial intelligence unit 28 has a function of automatically generating images related to the hobbies of the user 21.

[0035] (user terminal) 1C is a portable computer that can be carried by a user 21 while moving, for example, while the user 21 is walking outdoors, while the user 21 is riding a bicycle, while the user 21 is using public transportation, etc. Examples of the user terminal 13 include a smartphone, a tablet terminal, a digital camera, a laser scanner, etc. Digital cameras include single-lens reflex cameras. The user terminal 13 includes a main body (casing), a processor 30, a main memory 31, an auxiliary memory 32, an operation unit 33, a display unit 34, an image acquisition unit 35, a microphone 36, a speaker 37, a communication interface 38, etc.

[0036] The processor 30 is provided inside the main body and is composed of a central processing unit (CPU) that integrates an arithmetic unit (arithmetic circuit) and a control unit (control circuit). The processor 30 is communicatively connected to a main memory 31, an auxiliary memory 32, an operation unit 33, a display unit 34, an image acquisition unit 35, a microphone 36, a speaker 37, and a communication interface 38 via a bus 39. By executing an application, the processor 30 processes signals, information, and data input from other devices and circuits provided inside the main body, and also processes signals, information, and data input from devices and circuits provided outside the main body. Furthermore, by executing an application, the processor 30 controls other devices and circuits provided inside the main body, and also controls devices and circuits provided outside the main body.

[0037] The application may be a web app used on a web browser, a native app installed and used on the user terminal 13, or a hybrid app that combines the properties of both a web app and a native app. By executing the application, the processor 30 processes information obtained from the auxiliary memory 32 and information obtained from the management computer 11. The processing performed by the processor 30 includes calculation, judgment, comparison, control, etc.

[0038] The processing executed by the processor 30 includes adding, changing, and updating information stored in the auxiliary memory 32. The non-transitory applications executed by the processor 30 include those stored in the auxiliary memory 32 and those obtained from the management computer 11. The information processed by the processor 30 includes images, various data, map information, user information, activity information of the user 21, etc. The images include photographs, still images, videos, illustrations, animations, etc.

[0039] The main memory 31 is a volatile storage device, and functions as a work area and a buffer area when the processor 30 executes processing. The auxiliary memory 32 is a non-volatile, i.e., non-transient, storage device, and stores non-transient applications. The auxiliary memory 32 has a larger capacity than the main memory 31, and operates in response to input and output commands from the processor 30.

[0040] The auxiliary memory 32 includes, for example, a magnetic disk, an optical disk, a flash memory, etc. Examples of magnetic disks include hard disk drives, and examples of optical disks include compact discs, digital video discs, and Blu-ray discs. Flash memory is a type of semiconductor memory, and examples of flash memory include SD memory cards, USB flash drives, and solid-state drives. At least one element included in the auxiliary memory 32 can be understood as a non-transitory storage medium 32A that stores non-transitory applications and various information and is computer-readable.

[0041] The auxiliary memory 32 stores applications executed by the processor 30, information before being processed by the processor 30, information resulting from processing by the processor 30, etc. The information before being processed by the processor 30 and information resulting from processing by the processor 30 include images, map information, user information, activity information of the user 21, etc. Images include photographs, still images, videos, illustrations, animations, etc.

[0042] The operation unit 33 is operated by the user 21. The user 21 can operate the operation unit 33 to input various information and data to the user terminal 13, input selection instructions from the user 21, issue operation instructions to the user terminal 13, and the like. The operation unit 33 includes, for example, various operation buttons for operating the user terminal 13, a shutter button for taking a photograph with the user terminal 13, and the like. The information and data input to the user terminal 13 by operating the various operation buttons includes, for example, images, letters, numbers, sentences, symbols, and the like.

[0043] The display unit 34 is a device that outputs various information and data in a form that can be seen by the user 21. The display unit 34 includes, for example, a liquid crystal display, an organic EL display, etc. Note that various operation buttons and a shutter button may be displayed on various screens displayed on the display unit 34. In other words, the display unit 34 may also serve as the operation unit 33.

[0044] The microphone 36 is a device that acquires the voice of the user 21 and sounds around the user terminal 13, and converts the acquired sounds into electrical signals. The speaker 37 is a device that outputs sound information acquired from the management computer 11, sounds processed by the processor 30, and sounds acquired by the microphone 36 into the space around the user terminal 13.

[0045] The image acquisition unit 35 is a device that captures images of the scenery, landscapes, buildings, people including the user 21, animals, etc., surrounding the user 21 who owns the user terminal 13 and acquires the images. If the user terminal 13 is a smartphone or a tablet terminal, the image acquisition unit 35 functions as a so-called camera. The image acquisition unit 35 functioning as a camera has a lens, a mirror, an optical viewfinder, an image sensor, an image processing engine, etc. If the user terminal 13 is a laser scanner, the image acquisition unit 35 has a light source, a lens, a mirror, an optical viewfinder, an image sensor, an image processing engine, etc. The image acquisition unit 35 may be provided directly on the main body of the user terminal 13, or may be connected to the main body of the user terminal 13 via a wireless communication interface or a wired communication interface.

[0046] The communication interface 38 includes devices, equipment, and standards that connect the user terminal 13 to the network 12 and satellites via at least one of a wireless communication system and a wired communication system. The communication interface 38 includes cables, antennas, routers, etc. The network 12 includes an internetwork, a personal area network, a local area network, a campus area network, etc. The user terminal 13 obtains information sent from the management computer 11 and external devices 19 and signals from satellites via the communication interface 38. The user terminal 13 outputs information to be sent to the management computer 11 and external devices 19 via the communication interface 38.

[0047] The processor 30 is configured to load and execute non-temporary applications to function as an acquired information processing unit 40, a transmitted information processing unit 41, a map information processing unit 42, a position detection unit 43, a traveled distance detection unit 44, and a step count detection unit 45. The acquired information processing unit 40 processes various information acquired from the management computer 11 and external device 19, and stores the processing results in the auxiliary memory 32. The transmitted information processing unit 41 sends the information processed by the processor 30 and the information stored in the auxiliary memory 32 to the management computer 11.

[0048] The map information processing unit 42 processes map information acquired from the management computer 11 and external device 19, stores the map information in the auxiliary memory 32, updates the map information in the auxiliary memory 32, and so on. The position detection unit 43 is configured, for example, with a GPS (Global Positioning System), processes signals received from four or more artificial satellites, and performs the following functions by referring to the map information: The position detection unit 43 has a function of detecting the position of the user terminal 13 in the map information, that is, the current position of the user terminal 13. The current position of the user terminal 13 is synonymous with the current position of the user 21. The position detection unit 43 also detects the actual movement route of the user terminal 13 from the current position of the user terminal 13 to the destination, and stores the detected result in the auxiliary memory 32.

[0049] The travel distance detection unit 44 has a function of detecting the travel distance of the user 21 within a predetermined time, the travel distance from the start position, etc., using information such as the current position of the user terminal 13 in the map information and roads shown in the map information. The step count detection unit 45 processes signals from an acceleration sensor or a pendulum sensor provided in the user terminal 13 to detect the number of steps taken by the user 21 within a predetermined time, the number of steps from the start position, etc.

[0050] (Goggles explanation) The goggles 56 are communicatively connected to the user terminal 13. The goggles 56 include a main body, a right-eye camera 57 and a left-eye camera 58, a right-eye display 59 and a left-eye display 60, a speaker 61, a microphone 62, a sensor 63, a communication interface 64, a processor 65, a memory 66, etc. The main body is worn on the head of the user 21, and the right-eye camera 57 and the left-eye camera 58, the right-eye display 59 and the left-eye display 60, the speaker 61, the microphone 62, the sensor 63, the communication interface 64, and the processor 65 are provided in the main body. The sensor detects the amount of movement of the main body, the direction in which the main body moved, etc.

[0051] The processor 65 is communicatively connected to the right-eye camera 57 and the left-eye camera 58, the right-eye display 59 and the left-eye display 60, the speaker 61, the microphone 62, the sensor 63, and the communication interface 64. Images captured by the right-eye camera 57 and the left-eye camera 58 of the goggles 56 are processed by the processor 65. The information processed by the processor 65 is sent to the user terminal 13 via the communication interface 64. The information sent from the goggles 56 to the user terminal 13 is sent to the management computer 11.

[0052] Furthermore, the goggles 56 can display images included in the information acquired from the user terminal 13 on a right-eye display 59 and a left-eye display 60. Virtual reality (VR) images and augmented reality (AR) images can be displayed on the right-eye display 59 and the left-eye display 60. The goggles 56 can also output audio information included in the information acquired from the user terminal 13 from a speaker 61. Wearing the goggles 56, the user 21 can explore places around the world while viewing virtual reality (VR) images and augmented reality (AR) images. Furthermore, the right-eye camera 57 and the left-eye camera 58 can take photographs of images included in virtual reality (VR) and augmented reality (AR).

[0053] Furthermore, the artificial intelligence unit 28 of the management computer 11 can use generative artificial intelligence to generate virtual information about the travel route and destination selected and actually performed by the user 21, including not only images at the time of the actual activity, but also images and audio from a time before (past) the actual activity and images and audio from a time after (future) the actual activity. The virtual information generated by the artificial intelligence unit 28 can be sent from the management computer 11 to the user terminal 13. The goggles 56 utilizes the virtual information provided to the user terminal 13 by the management computer 11 in steps S23 and S24. Images are displayed on the right-eye display 59 and left-eye display 60 of the goggles 56, and audio is output from a speaker 61.

[0054] (Explanation of information processing methods) FIG. 2 shows an example of an information processing method performed in the information processing system 10.

[0055] (1) Processing performed on the user terminal In step S10, the user terminal 13 is connected to the website of the network 12. Then, a registration procedure screen is displayed on the display unit 34 of the user terminal 13. The registration procedure screen includes menus such as "Enter user information," "Register," and "If you're already registered, click here." When the user 21 selects "Enter user information," the user can enter user information. If the user 21 is an individual, the user information includes the user's name, date of birth, gender, address, email address, hobbies, preferences, interests, password, rate plan, telephone number, and the user's hobbies. If the user 21 is a company or organization, the user information includes the company or organization's name, address, email address, password, rate plan, telephone number, services and products provided by the company or organization, and the like.

[0056] Furthermore, when "Register" is selected in step S10, the entered user information is sent from the user terminal 13 to the management computer 11. Then, the user information is registered in the management computer 11, and an account is assigned to the user. The user terminal 13 obtains the account from the management computer 11. In step S11, the user 21 selects "Click here if already registered" on the registration procedure screen described above, enters the account and password, and sends them to the management computer 11.

[0057] Then, the user terminal 13 can execute the application provided by the management computer 11 from step S12 onwards. When the application is executed, a selection screen is displayed on the display unit 34. The selection screen can display destination candidates based on pilgrimages, history, movies, anime, dramas, people's names, registered user hobbies, etc. The user 21 operates the user terminal 13 to select one of the destination candidates by specifying the travel distance, number of steps, required time, etc.

[0058] Furthermore, in step S12, the means of transportation (course) from the current location to the destination can be displayed on the selection screen of the display unit 34. For example, brisk walking, wheelchair, guide dog / pet, bicycle, etc. are displayed as means of transportation. The user 21 can select one of the means of transportation by operating the user terminal 13. When a means of transportation is selected, candidate destinations that are compatible with that means of transportation are displayed.

[0059] In step S12, the user 21 can also select by specifying the current location, destination, distance traveled, number of steps, required time, etc., by voice input using the microphone 36. Then, when the user 21 operates the user terminal 13 to select items such as the current location, destination, distance traveled, number of steps, required time, etc. of the user 21, the selected items are sent from the user terminal 13 to the management computer 11.

[0060] When a required item is selected on the selection screen, an activity screen 46 such as that shown in FIG. 3 is displayed on the display unit 34. The activity screen 46 displays the current location of the user terminal 13, specifically a map from the start position to the destination, potential routes from the start position to the destination, etc. The current location of the user 21 is detected by the position detection unit 43 of the user terminal 13. The user 21 can also input their current location on the map by operating the operation unit 33. Furthermore, in addition to a modern map, a map from the start position to the destination can also be displayed from a past era by setting a time period.

[0061] Additionally, the activity screen 46 displays an audio guide button 47, a photo taking button 48, etc. The acquired information processing unit 40 processes the operation details of the audio guide button 47 and the photo taking button 48. The microphone 36 outputs audio in response to the operation of the audio guide button. The image acquisition unit 35 performs processing and operations in response to the operation of the photo taking button 48.

[0062] The user 21 carries a user terminal 13, and in step S13 starts moving from a current location toward a destination. The user terminal 13 is, for example, a smartphone or a tablet terminal. The moving route and intermediate positions of the user 21 from when the user starts moving from the current location until the user reaches the destination are detected by the position detection unit 43. The moving route and intermediate positions of the user 21 are sent from the user terminal 13 to the management computer 11.

[0063] Additionally, the user 21 can operate the photo taking button 48 on the activity screen 46 during the time from the current location to the destination. This causes a photo taking screen to be displayed on the display unit 34. Various types of photos can be taken on the photo taking screen 49. Images acquired by the image acquiring unit 35 during the time from the current location to the destination by the user 21 are stored in the auxiliary memory 32 of the user terminal 13. Furthermore, the images acquired by the image acquiring unit 35 are sent from the user terminal 13 to the management computer 11.

[0064] Furthermore, when the photographing button 48 on the activity screen 46 is operated, a photographing screen 49 as shown in FIG. 4 is displayed on the display unit 34. When the shutter button is operated while the photographing screen 49 is displayed, a photograph of the image displayed on the photographing screen 49 is taken. Furthermore, by operating the operation button on the operation unit 33, the photographing screen 49 can be divided into a first area 50 and a second area 51. The respective positions of the first area 50 and the second area 51 can be changed as desired. For example, the first area 50 and the second area 51 may be arranged side by side, horizontally or vertically, as shown in FIG. 4. Furthermore, the first area 50 may be arranged inside the second area 51, or the second area 51 may be arranged inside the first area 50.

[0065] FIG. 4 shows an example in which the first region 50 is disposed inside the second region 51. Furthermore, the respective outer peripheral shapes of the first region 50 and the second region 51 can be changed arbitrarily. For example, the respective outer peripheral shapes of the first region 50 and the second region 51 may be any of a rectangle, a circle, an ellipse, a trapezoid, a triangle, etc. Furthermore, the respective areas of the first region 50 and the second region 51, i.e., the angle of view, can be changed. Also, either the first region 50 or the second region 51 can be made semi-transparent on the shooting screen.

[0066] Then, the user 21 can obtain a "new image" by operating the shutter button of the operation unit 33 on the shooting screen 49. A "new image" is a combination of a "basic image" and an "additional image." For example, the "basic image" can be an object in a real location around the user terminal 13 while the user 21 is active, such as a building, a landscape, or a person. An "additional image" is an image that the user 21 intends to add to the "basic image." The "additional image" can be, for example, a photo taken in the past, an animated image, or the like. Note that the technical meanings of the "basic image" and "additional image" may be reversed from those described above.

[0067] Furthermore, the user 21 can operate the operation unit 33 to place the first area 50 inside the second area 51 and make the first area 50 semi-transparent. Also, a landscape photo taken in the past can be placed in the second area 51 as an "additional image." The "additional image" is stored in the auxiliary memory 32. Then, with the "basic image" placed in the first area 50, a photograph can be taken to obtain a "new image." Furthermore, the location where the "basic image" was taken can be the same as the location of the landscape photo in the "additional image."

[0068] Then, in step S14, the "new image" acquired by the image acquisition unit 35 is stored in the auxiliary memory 32 of the user terminal 13, and is sent from the user terminal 13 to the management computer 11. If the user 21 is in the "basic image," the acquired information processing unit 40 can also use an AR (virtual reality) effect filter to dress the image of the user 21 in cosplay costumes or the like.

[0069] Furthermore, actual movement information detected from the time when the user 21 starts moving from the starting position toward the destination, specifically, from the date and time until the user 21 reaches the destination, is stored in the auxiliary memory 32 of the user terminal 13. The actual movement information is also sent from the user terminal 13 to the management computer 11. The actual movement information includes, for example, the actual movement route, the actual required time, the actual number of steps, the actual movement distance, etc. The processing performed by the user terminal 13 in step S14 is realized using an application provided by the management computer 11.

[0070] In step S15 following step S14, the user terminal 13 acquires the judgment result and points from the management computer 11. The user terminal 13 stores the acquired judgment result and points in the auxiliary memory 32. The judgment result is a result of determining whether or not the user 21 has reached the destination. The meaning of points will be described later.

[0071] (Processing performed on the management computer) In step S20, the management computer 11 publishes a website on the network 12. When the management computer 11 acquires user information from the user terminal 13 in step S21, it registers the user and assigns an account to identify and specify the registered user 21. The management computer 11 stores the user information and account processed in step S21 in the auxiliary memory 16 and sends the account to the user terminal 13.

[0072] After step S21, when an account and password are entered on the "registration procedure screen" of the user terminal 13, the management computer 11 proceeds to step S22, and an environment in which the application can be used on the user terminal 13 is realized. Specifically, a usage screen and the like are provided from the management computer 11 to the user terminal 13. This allows the user terminal 13 to obtain various information from the usage screen displayed on the display unit 34, and to send various information to the management computer 11.

[0073] In step S23 following step S22, the management computer 11 acquires the information sent from the user terminal 13 in steps S12 and S13, processes the acquired information, and stores it in the auxiliary memory 16. Furthermore, in step S23, the management computer 11 provides the user terminal 13 with various types of information that can be used by the user terminal 13 and the goggles 56 from the time the destination, etc. is set on the user terminal 13 until the user 21 arrives at the destination.

[0074] In step S24, the determination unit 27 of the management computer 11 determines whether the user 21 has reached the destination by processing the photographic image, actual movement information, etc. acquired from the user terminal 13. The management computer 11 also stores the determination result of step S24 in the auxiliary memory 32. The reference information used to determine whether the user 21 has reached the destination is stored in the auxiliary memory 32. This reference information includes the range of the standard time required for the user 21 to travel from the starting position to the destination, the range of the standard number of steps, the range of the standard traveled distance, the standard image taken at the destination, etc.

[0075] The management computer 11 determines that "user 21 has reached the destination" when one or more of the following conditions are met: the current location of user 21 is at the destination in the map information (map data), the actual required time is within a standard required time range, the actual number of steps is within a standard number of steps, the actual travel distance is within a standard travel distance range, and an image of user 21 taken at the destination is included in part of the "new image." If only one of the conditions is met, the management computer 11 determines that "user has not reached the destination."

[0076] The management computer 11 sends the determination result of step S24 to the user terminal in step S25. Furthermore, if the management computer 11 determines in step S24 that the user 21 has reached the destination, then in step S25 the management computer 11 awards points to the user terminal 13 and stores the determination result that the user 21 has reached the destination in the auxiliary memory 32. Furthermore, in step S25 the management computer 11 sends to the user terminal 13 the determination result that the user 21 has reached the destination and the fact that points have been awarded to the user 21.

[0077] While the user terminal 13 is performing the processes of steps S12 to S14, the management computer 11 executes the process of step S23 to send various information to the user terminal 13. The various information includes information about the starting position and its surroundings, the travel route and notable facilities in the surroundings, information about events and history, checkpoints, quizzes, etc. The user 21 answers quizzes given at checkpoints from step S12 to step S14, and the actual number of steps traveled and points are added. Furthermore, by thinking about the answers to the quizzes, the user 21 can expect to prevent a decline in cognitive function.

[0078] Furthermore, by operating the audio guide button 47, audio guide can be output from the speaker 37 and a text explanation can be displayed on the display unit 34. The user 21 can select the voice for the audio guide from male, female, animated character, celebrity, etc. The user 21 can select the text explanation from any of multiple languages.

[0079] (additional processing) The user terminal 13 can obtain various information from the usage screen displayed on the display unit 34 in step S12 and can send the various information to the management computer 11. Furthermore, the usage screen provided to the user terminal 13 in step S22 can be displayed on the display unit 34 at any timing as long as the user is logged in to the management computer 11 from the user terminal 13. In other words, the timing of steps S12 and S22 is not limited. Furthermore, if the user terminal 13 is logged in to a website, the management computer 11 provides the user terminal 13 with various information to be used by the user terminal 13 and the goggles 56 in steps S23 and S24.

[0080] (Explanation of pricing plans) The fee plans for using applications on the user terminal 13 include, for example, a basic plan, a paid membership, and a business membership.

[0081] The basic plan is provided free of charge, for example, and can realize the following functions: a function to redeem points according to the actual number of steps taken, a function to allow the user terminal 13 to acquire various information, such as images and documents, a function to acquire guide voice and explanations in text format, and a function to acquire VR images from the management computer 11.

[0082] Paid membership is offered for, for example, 500 yen per month. Paid membership can realize the functions of the professional tool in addition to the functions of the basic plan. The function of the professional tool is a function that allows the user terminal 13B to obtain, from the management computer 11, various information and data obtained from the user terminal 13A and stored in the auxiliary memory 16 under specified conditions. The specified conditions are, for example, that the user 21A is not personally identified.

[0083] A business membership is offered for a monthly fee of, for example, 1,500 yen. In addition to the functions of the basic plan and the professional tool, a business membership can also realize a sponsorship function and a company's service promotion function. The sponsorship function is a function in which a company, for example, a manufacturer that provides shoes used by user 21A for walking, or user 21B, a manufacturer that provides a camera used by user 21A, supports sports, cultural and artistic activities, events, etc. by providing money, goods, and personnel. The company's service promotion function is a function in which various information provided from management computer 11 to user terminal 13A includes a map showing the location of the company or organization that owns user terminal 13B, and includes information about the company's services in text format.

[0084] (Application example) The application executed on the user terminal 13 can realize the following first, second, third and fourth functions regardless of whether the user terminal 13 is a portable computer or a fixed computer. Fixed user terminals 13 include desktop computers and notebook computers.

[0085] (First function) The application executed on the user terminal 13 can realize a function of arranging a basic image and an additional image side by side, either vertically or horizontally, on the display unit 34. The application executed on the user terminal 13 can realize a function of arranging a basic image 52 and an additional image (including animation) 53 on the display unit 34 in an overlapping manner, as shown in Fig. 5, and gradually changing the basic image 52 over time, and finally switching to the additional image 53 to be displayed on the display unit 34. Conversely, the additional image 53 may be gradually changed over time, and finally switched to the basic image 52 to be displayed on the display unit 34.

[0086] (Second function) 5, the application executed on the user terminal 13 can realize a function of superimposing an additional image 53 on a basic image 52 and arranging the additional image 53 on the display unit 34, and switching from the additional image 53 to the basic image 52 when the user 21 slides his / her finger across the display unit 34. Also, a function of superimposing a basic image 52 on the additional image 53 and arranging the basic image 52 on the display unit 34, and switching from the basic image 52 to the additional image 53 when the user 21 slides his / her finger across the display unit 34 can be realized.

[0087] (Third function) The application executed on the user terminal 13 can realize a function of arranging the additional image 53 on the display unit 34 so that it is superimposed on the basic image 52, and when the user 21 rubs the display unit 34 with his / her finger, a part of the additional image 53 arranged on top peels off, revealing the basic image 52 underneath. Also, a function of arranging the basic image 52 on the additional image 53 so that it is superimposed on the display unit 34, and when the user 21 rubs the display unit 34 with his / her finger, a part of the basic image 52 arranged on top peels off, revealing the additional image 53 underneath can be realized.

[0088] (Fourth function) 6 is another example of a screen displayed on the display unit 34. The application executed on the user terminal 13 can realize a function of arranging a basic image 52 and an additional image 53, which are images of the same person taken in the same posture and at the same size, side by side on the display unit 34, and displaying multiple vertical grid lines 54 on each of the basic image 52 and the additional image 53, and displaying multiple horizontal grid lines 55 on each of the basic image 52 and the additional image 53. FIG. 6 shows an example in which the basic image 52 and the additional image 53 are arranged side by side on the display unit 34. This makes it possible to see at a glance, for example, changes in the body shape of the same person.

[0089] (Subroutines that can be executed on the management computer) The processor 14 of the management computer 11 can execute the subroutine of FIG. 7 in combination with the control example of FIG. 2. In step S30, the management computer 11 acquires various information from the user terminal 13. In step S31, the management computer 11 determines whether the user 21 performed the previous exercise on a specified date. The image acquisition unit 35 of the user terminal 13 has a camera function, so the user 21 can take an image of themselves exercising. The user terminal 13 can send an image of the user 21 exercising to the management computer 11. The image sent from the user terminal 13 to the management computer 11 is accompanied by auxiliary information such as the date the image of the user 21 exercising was taken.

[0090] If the management computer 11 determines Yes in step S31, it determines whether a destination was selected on the user terminal 13 on the date on which the user 21 previously exercised. If the management computer 11 determines Yes in step S32, it proceeds to step S33, and permits the user terminal 13 to perform the first to fourth functions.

[0091] In step S34 following step S33, the management computer 11 determines whether the user 21 arrived at the destination on the date on which the user 21 previously exercised. The management computer 11 can make the determination in step S34 in the same manner as the determination in step S24 in FIG. 2.

[0092] If the management computer 11 determines Yes in step S34, then in step S35 the artificial intelligence unit 28 can automatically generate basic images and additional images related to the hobby of the user 21. The management computer 11 provides at least one of the generated images to the user terminal 13 in step S35, and ends the routine of Fig. 7. On the other hand, if the management computer 11 determines No in step S34, the artificial intelligence unit 28 does not generate basic images and additional images related to the hobby of the user 21, and ends the routine of Fig. 7.

[0093] If management computer 11 determines No in step S31 or if it determines No in step S32, it executes the process of step S37 and ends the routine of Fig. 7. In step S37, management computer 11 prohibits user terminal 13 from performing the first to fourth functions. Note that management computer 11 may omit the determination of step S31 in Fig. 7.

[0094] (Other application examples) Application example 1 A laser scanner serving as a user terminal 13 is loaned to a user 21 by an administrator 20 of the management computer 11. The laser scanner acquires positional information of an object in three-dimensional space by irradiating it with laser light. The laser scanner can acquire large amounts of point cloud data from a position away from the object without contact and without using a prism. In other words, the laser scanner can acquire point cloud coordinates (point cloud data) in three-dimensional space. The user 21 uses the laser scanner to collect various information and data from the start of movement at a starting position until reaching a destination. The collected information and data are sent from the user terminal 13 to the management computer 11. The acquired information processing unit 24 of the management computer 11 executes a process to pay a purchase fee for the collected information and data to the user terminal 13. The acquired information processing unit 24 of the management computer 11 also sets the purchase fee according to the quantity and quality of the various information and data. For example, the purchase fee is set relatively higher as the quantity of the various information and data increases or the quality of the various information and data increases.

[0095] Application example 2 The goggles 56 can display images included in information acquired from the user terminal 13 on a right-eye display and a left-eye display. The goggles 56 can also output audio information included in information acquired from the user terminal 13 from a speaker. The provided information processing unit 25 realizes a function of providing the information on the network 12 and allowing multiple user terminals 13 to share the photos. The artificial intelligence unit 28 has a built-in function of automatically processing images acquired from the user terminal 13 to bring out their beauty.

[0096] Application example 3 The reward processing unit 29 of the management computer 11 performs processing to grant rewards according to the distance actually walked by the user 21 and the environmentally friendly behavior, and also realizes the function of transmitting the rewards to the user terminal 13. This encourages the user 21 to live a healthy lifestyle and behave in a sustainable manner.

[0097] Application example 4 The artificial intelligence unit 28 of the management computer 11 learns the preferences and interests of the user 21 and proposes individually customized travel route candidates and content to the user terminal 13. The artificial intelligence unit 28 of the management computer functions as an AI assistant that processes the voice of the user 21 and realizes natural conversations using voice recognition technology.

[0098] The judgment unit 27 of the management computer 11 processes the audio information and image information acquired from the user terminal 13 to determine whether the user 21 has encountered an unknown place or creature. The artificial intelligence unit 28 of the management computer 11 automatically generates support information to support the actions of the user 21 when the user 21 encounters an unknown place or creature. The support information includes, for example, route guidance from the unknown place to a place where public transportation is available, route guidance from the unknown place to the nearest station, the ecosystem of the unknown creature, the activity habits of the unknown creature, etc. The information automatically generated by the artificial intelligence unit 28 is provided from the management computer 11 to the user terminal 13.

[0099] Application example 5 The artificial intelligence unit 28 of the management computer 11 automatically generates a story about a virtual world or space according to the preferences and interests of the user 21. It analyzes historical information about the user 21, such as their actions, destinations, and travel routes, and automatically generates content that the user 21 finds attractive. The provided information processing unit 25 provides the automatically generated content to the user terminal 13 in real time.

[0100] Application example 6 The artificial intelligence unit 28 of the management computer 11 automatically generates a destination, potential travel routes, travel distance, travel time, and number of points that suit each user 21 from various information acquired from the user terminal 13 and information stored in the auxiliary memory 16. The provided information processing unit 25 provides the automatically generated information to the user terminal 13.

[0101] Application example 7 The application executed by the management computer 11 has data analysis and personalization functions. The artificial intelligence unit 28 of the management computer 11 analyzes the behavioral data of the user 21 acquired from the user terminal 13. The artificial intelligence unit 28 of the management computer 11 further automatically generates information to be provided, including an experience customized to the individual needs and interests of the user 21. The information to be provided automatically generated by the artificial intelligence unit 28 is used for sales to companies and research institutions that use the user terminal 13B.

[0102] Application example 8 The application executed on the user terminal 13 provides a map and community that connects the entire globe. No matter where a user 21A is on the globe, he or she can connect and interact with other users 21B through this application. In addition, the provided information processing unit 25 of the management computer 11 provides the user terminal 13 with real-time map information as well as information about community activities and events in each region.

[0103] Application Example 9 The application executed on the management computer 11 creates an environment in which virtual reality experiences, augmented reality experiences, and photos can be shared among all user terminals 13. Users 21 can explore places around the world through virtual reality and augmented reality experiences, and take and share photos. The application's photo sharing function also incorporates a function in which an artificial intelligence unit 28 automatically processes images to enhance their beauty.

[0104] Application Example 10 The application executed on the management computer 11 realizes a function that allows step points to be used as rewards for cashless payment services and as virtual currency. The reward processing unit 29 provides virtual currency and points to the user terminal 13 according to the distance actually walked by the user 21 and the environmentally friendly behavior of the user 21. This encourages the user 21 to adopt a healthy lifestyle and sustainable behavior.

[0105] Application Example 11 The artificial intelligence unit 28 has an assist function, and automatically generates a story, an interactive adventure game based on the story, and experiential virtual reality content.

[0106] Application Example 12 The management computer 11 has a function of selling, for a fee, the content automatically generated by the artificial intelligence unit 28. This allows the administrator 20 of the management computer 11 to earn profits.

[0107] [Function utilizing scan matching between 3D point cloud maps and vector maps] Real-time 3D navigation Augmented reality city guides Virtual building renovation Disaster simulation and rescue assistance ·Virtual space travel experience These features provide a new experience by combining point cloud maps and vector maps.

[0108] [Notification function] Haptic feedback Audio prompts and voice control - Audio explanation of point cloud data Use of AI assistants -Information input by voice recognition This will create an environment where even blind people and the elderly can use the app safely and effectively.

[0109] [AI camera angle adjustment function] AI-powered scene analysis · Use of point cloud maps and vector maps -Automatic angle adjustment -Adjustment to suit user needs Real-time feedback AI-enabled camera systems not only help photographers capture a scene more effectively, but also streamline the process by accurately displaying locations on the globe using point cloud maps that associate latitude, longitude, and coordinates, improving the quality of the footage captured.

[0110] [Business Model] Procuring and purchasing point cloud data. In this case, point cloud data is procured by lending out laser scanners (for a fee or free of charge) and smartphones (for a fee or free of charge).

[0111] We rent out laser scanners to various people and modes of transportation (cars, bicycles, walking, etc.) to collect and update data. Riders (users) rent laser scanners, collect data in specific areas or locations, and earn revenue from the data they provide to our company. We offer a data purchase fee to users who procure the data. We set an appropriate purchase price depending on the quantity and quality of the data.

[0112] Data processing and analysis ·Map function development Virtual tourism experience Education and learning apps For select clients, such as businesses and local governments, the company earns additional revenue by providing custom data solutions and consulting services.

[0113] [Functions and Features] ·Maps and communities that connect the whole No matter where you are on the planet, the app allows you to connect and interact with other users, providing real-time map information as well as local community activities and events.

[0114] VR / AR experiences and photo sharing Users can explore places around the world through virtual reality (VR) and augmented reality (AR), take and share photos, and the photo sharing feature incorporates AI to automatically enhance and enhance images.

[0115] Health and brain training features The app helps users manage their health, offering daily exercise and diet tracking, as well as brain-training games and audio-guided relaxation meditations.

[0116] Real-time environmental monitoring The app collects real-time environmental data from around the globe and provides it to users. By providing important environmental information such as air pollution, earthquake predictions, and climate change information, users are encouraged to take action to live more sustainable lives.

[0117] · Cashless payment service rewards and virtual currency for step points The system will allow users to earn cryptocurrency and points based on the distance they walk and the environmentally friendly actions they take, encouraging healthy lifestyles and sustainable behavior.

[0118] AI Assistant It learns the user's preferences and interests and suggests individually customized exploration routes and content. It is an AI assistant that listens to the user's voice and uses voice recognition technology to realize natural conversations. When the user encounters unknown places or creatures, the AI ​​automatically provides information to ensure safety.

[0119] AI chatbots An AI chatbot with emotion recognition capabilities that analyzes the user's emotions and psychological state and provides appropriate support and advice. A function that automatically forms groups based on common interests and hobbies to promote communication between users.

[0120] AI content generation AI automatically generates virtual worlds and space stories tailored to the user's preferences and interests. By analyzing user behavior and feedback, AI creates more engaging content and delivers it in real time.

[0121] Undersea exploration and sharing Users can explore the ocean floor via robots and submersibles to uncover its mysteries, and can share their explorations with other users through live streaming and photo and video sharing features.

[0122] Marine conservation and volunteering The app focuses on protecting the marine environment, educating users about the importance of marine ecosystems and biodiversity, and offering them the opportunity to participate in volunteer activities such as ocean cleanups and coral reef protection.

[0123] Continental exploration and earth studies Users can explore unknown places on Earth and learn about their cultures and history, and the site also offers educational content on the history of continental drift and how the Earth was formed.

[0124] Space exploration and astronomy The app will aid in the exploration of space through spacecraft and satellites, giving users the opportunity to delve deeper into the mysteries of the universe, and will also provide information on astronomy and astrophysics.

[0125] Access to air travel and the aviation industry Not only can users enjoy the experience of flying, but they can also receive special experiences and discounts through partnerships with airlines and aircraft manufacturers.

[0126] Space Consulting and Future Prediction The app works with space experts and futurists to provide space exploration consulting and future predictions, allowing users to explore future prospects and the possibilities of space development.

[0127] [Content composition] AI walking course suggestions Based on various information, we suggest courses, routes, distances, times, and number of points that suit each individual.

[0128] AI music We offer emotional and immersive content such as music, soundscapes, and visual art generated by AI.

[0129] AI Assist We propose interactive adventure games and experiential VR content based on stories automatically generated by AI.

[0130] AI support & management It proposes AI-powered content that offers meditation and relaxation modes to support and manage users' physical and mental health.

[0131] Exploration Series Explore the Earth's oceans: Users explore the ocean floor and observe coral reefs and undersea creatures.

[0132] Into the unknown: Users board a spaceship and travel deep into the solar system and galaxy.

[0133] Time travel adventure Users can time travel to past and future eras and explore history.

[0134] Universal Community Earth Community: Users on Earth interact and share Earth culture and events. Space Community: Alien lifeforms and space travelers interact and share space culture and technology.

[0135] Relaxation and meditation Earth's Natural Sounds: Users can relax while listening to natural sounds such as the ocean, forest, and mountains.

[0136] Cosmic sounds of space: Users meditate while feeling the silence of space and the brilliance of the stars.

[0137] Future Outlook Earth's future predictions: Experts provide predictions about the Earth's future and simulations of environmental changes. Space exploration predictions: Cosmologists predict the future of the universe and propose new possibilities for space exploration.

[0138] Virtual reality experience Virtual tour of Earth: Users can experience famous tourist spots and cultural heritage sites in VR. Virtual travel in space: Users can experience outer space and unknown planets in VR.

[0139] Edutainment content Earth Learning Quiz: Users can take quizzes about the geography, history, and culture of the Earth. Space Science Game: Users can have fun while learning through games about space physics and astronomy.

[0140] [Business Plan] Data analysis and personalization The app analyzes users' behavioral data to provide a customized experience tailored to their individual needs and interests, and this data can also be sold to companies and research institutions.

[0141] Partnerships and Advertising The app will build partnerships with health companies and environmental organizations to promote their products and services. It will generate revenue through advertising and sponsorship deals with airlines, shipping companies, environmental organizations, space companies, and more. It will also seek companies to sponsor specific expeditions and events. It is expected to generate advertising revenue from environmentally conscious brands and companies. It will enter the education market by offering educational programs through partnerships with schools and universities. It will generate revenue through licensing fees from educational institutions and the sale of educational materials.

[0142] - Use of virtual currency and point systems The virtual currency and points earned within the app can be used for discounts and rewards through partnerships, motivating users to actively use the app, connect with the community, and contribute to improving their health.

[0143] Ecotourism and sustainable travel The app promotes ecotourism through exploration of oceans, continents and space, and booking trips and experiences to selected locations includes a donation to support environmental conservation and sustainable development in that area.

[0144] Virtual reality experience sales They generate revenue by providing virtual experiences using VR and AR, such as virtual tours of undersea exploration and space walks.

[0145] AI assistant subscription model Charging a monthly or annual subscription fee to access the features and services of an AI assistant.

[0146] · Selling AI-generated content Earn revenue by selling AI-generated content for a fee.

[0147] AI-based user analysis and targeted advertising AI analyzes user behavior patterns and preferences and generates advertising revenue by providing targeted ads to advertisers.

[0148] Space Tour Operations Partner with space tour operators to arrange space travel and space colonization, and earn revenue from arrangement fees and commissions.

[0149] Interdimensional communication service It provides communication services to other dimensions and universes and earns revenue from communication fees and service charges.

[0150] Historical exploration and ancient civilization tours Offer historical exploration and ancient civilization tours, allowing users to experience past worlds and cultures, and generate revenue from tour fees and related merchandise sales.

[0151] Future prediction service Providing future prediction services for a fee, providing users with outlooks and possibilities for the future, and earning revenue from consulting fees and sales of prediction results.

[0152] The management computer 11 may have a cross-reality function that combines virtual reality and augmented reality. It may also have a function that uses ultrasound to give the user the sensation of touching an object in front of them. In addition to artificial intelligence, it may also have an artificial general intelligence (AGI) function and an artificial superintelligence (ASI) function. It may also have a companion matching function for when the user 21 goes out.

[0153] When the user 21 goes shopping, a shopping support function may be provided.

[0154] · It may have functions to support smartphone lectures, launching applications, recording information, organizing documents, etc.

[0155] - May have real-time monitoring capabilities by sharing maps and other information with family and friends.

[0156] The user terminal 13 may have a smart watch function.

[0157] If the user 21 does not go out for some reason, or wants to go out but is too lazy, the device may have a function to encourage the user 21 to get into the habit of doing light exercise until the user 21 goes out.

[0158] A simple home training function may be provided. For example, a function to give points (converted into the number of steps) for indoor training may be provided.

[0159] The device may have the function of an artificial intelligence trainer. The artificial intelligence may function as a trainer and display the form and pose of the user 21 in a human-shaped grid (in-camera and out-camera).

[0160] Artificial intelligence may also be used to provide camera autofocus functionality.

[0161] The device may have a function to provide a facial training (facial muscle training) menu.

[0162] The device may have a function for training the hands and feet of the user 21. For example, the user can use the in-camera to move their hands and feet in accordance with the pose grid or image of the AI ​​trainer's face, hands, and body. The device may also have a function for the user 21 to challenge themselves with training missions and receive points or rewards when they achieve goals or challenges.

[0163] The application may have a function that allows users 21 to take quizzes to increase points and compete in rankings. It may also have a function that allows users 21 to receive special bonuses and rewards by participating in periodic point-increase challenges. Furthermore, the application may have a function that allows users 21 to join many communities and actually go out through the application to increase points and participate in community activities.

[0164] This means that even if User 21 is unable to go out for some reason, they can easily earn the same points as if they were out and about, even while in bed. Also, by making training at home a habit, User 21 can prevent dementia and make it a daily habit.

[0165] (Effects of the embodiment) By using the application on the user terminal 13, the user 21, for example, a user 21 aged 60 or older, is motivated to go out and walk. Furthermore, by walking, the user 21 can contribute to eliminating lack of exercise and promoting good health.

[0166] Furthermore, as shown in Fig. 7, when the management computer 11 determines that a start position and a destination have been selected on the user terminal 13, it permits the user terminal 13 to perform a combining process that combines multiple images, including images related to the movement route from the start position to the destination, from the time the user 21 starts moving from the start position until the user reaches the destination. On the other hand, when the management computer 11 determines that a start position and a destination have not been selected on the user terminal 13, it prohibits the user terminal 13 from performing the combining process. The combining process includes the first to fourth functions described in Fig. 7. Therefore, the user 21 can use the realization of the first to fourth functions on the user terminal 13 as motivation for walking.

[0167] 7, the management computer 11 determines whether the user 21 has exercised before starting to move from the start position. If the management computer 11 determines that the user 21 has exercised and that the start position and destination have been selected, the management computer 11 permits the execution of the combining process in the user terminal 13. In contrast, if the management computer 11 determines that the user 21 has not exercised, or that the start position and destination have not been selected, the management computer 11 prohibits the execution of the combining process in the user terminal 13. Therefore, the user 21 can be motivated to exercise in advance before starting to move from the start position in order to realize the first to fourth functions in the user terminal 13.

[0168] 7, when the management computer 11 determines that the selection of the start position and the destination has been made on the user terminal 13, the management computer 11 performs a process of generating one or more images to be used for the combining process on the user terminal 13. On the other hand, when the management computer 11 determines that the selection of the start position and the destination has not been made on the user terminal 13, the management computer 11 does not generate one or more images to be used for the combining process on the user terminal 13. This can further increase the motivation of the user 21 to realize the first to fourth functions on the user terminal 13.

[0169] Furthermore, the management computer 11 can connect the user terminal 13A used by the user 21A with the user terminal 13B used by another user 21A. This allows the user 21A and the user 21B to communicate with each other by conversing and sharing information with each other. This can eliminate the sense of loneliness felt by each user 21. Furthermore, by having the user 21 answer the quiz, it becomes brain training, and by listening to the guide audio, it helps to activate the ears. This can prevent a decline in cognitive function.

[0170] Furthermore, when the determination unit 27 of the management computer 11 determines in step S24 that the user 21 has reached the destination, the reward processing unit 29 of the management computer 11 executes processing to provide a reward according to the number of steps (distance, etc.) actually walked by the user 21. The reward processing unit 29 adds up the reward, stores it in the auxiliary memory 16, and sends it to the user terminal 13.

[0171] Furthermore, the display unit 34 of the user terminal 13 can display maps and candidate travel routes, and may also display information about the sea, the seabed, etc. Furthermore, the artificial intelligence unit 28 of the management computer 11 can perform machine learning of historical information such as destinations and travel routes previously visited by the user 21, and "new images." The artificial intelligence unit 28 of the management computer 11 may then automatically generate information that the user 21 is likely to enjoy, such as destinations related to the user's hobbies, candidate travel routes with facilities related to the hobbies, audio guides about celebrities the user 21 likes, text explanations, and methods for taking "new images."

[0172] Furthermore, the artificial intelligence unit 28 of the management computer 11 can perform machine learning of information (destinations, travel routes, "new images," etc.) of multiple users 21 with similar preferences. The management computer 11 may then provide the same information to multiple user terminals 13 that is likely to please the users 21, such as destinations that match their hobbies, potential travel routes with facilities that match their hobbies, audio guides, text explanations, how to take "new images," etc.

[0173] Furthermore, the application provided by the management computer 11 has a function that allows information (destinations, travel routes, "new images," etc.) of users 21A with similar preferences to be acquired by the user terminal 13B of another user 21B, i.e., a function that allows information to be shared. Furthermore, the management computer 11 may distribute various information and data acquired from the user terminal 13B via social networking services on the network 12.

[0174] Furthermore, in step S24 of FIG. 2, the reference information used to determine whether or not the user 21 has reached the destination is stored in the auxiliary memory 16. Furthermore, the management computer 11 can determine that "the user 21 has reached the destination" when, for example, one or more of the conditions included in the reference information are met. Here, the artificial intelligence unit 28 of the management computer 11 may have a function to set two or more conditions for determining that "the user 21 has reached the destination." This improves the accuracy with which the management computer 11 determines whether or not the user 21 has reached the destination, and also improves the quality of the information and data stored in the auxiliary memory 16.

[0175] In addition, the management computer 11 can accurately and quickly search for information and data regarding the movements of the user 21 who has reached the destination from the various information and data stored in the auxiliary memory 16 of the management computer 11 and provide this to the user terminal 13.

[0176] Furthermore, the artificial intelligence unit 28 of the management computer 11 can not only process "new images" taken by the user terminal 13 with high accuracy, but also associate and process the latitude, longitude, and three-dimensional coordinate information of the location where the "new image" was taken. The artificial intelligence unit 28 of the management computer 11 can use the point cloud map stored in the auxiliary memory 16 to accurately display on the map the location on the Earth where the "new image" was created, thereby streamlining the process and improving the quality of the "new image" taken.

[0177] (supplementary explanation) The management computer 11 may be a single computer or a distributed computer made up of multiple devices, such as a server, a supercomputer, a mainframe, or a workstation.

[0178] An example of the technical meaning of the matters described in this embodiment is as follows: The information processing system 10 is an example of an information processing system. The management computer 11 is an example of an information processing device. The processor 14 is an example of a processor. The user terminals 13, 13A, and 13B are examples of user terminals. The user terminal 13B is an example of a service provider terminal.

[0179] Step S32 shown in FIG. 7 is an example of a first process, step S33 is an example of a second process, step S37 is an example of a third process, step S31 is an example of a fourth process, step S35 is an example of a fifth process, and step S36 is an example of a sixth process.

[0180] Step S23 shown in FIG. 2 is an example of the seventh process, step S24 is an example of the eighth process, step S23 and step S24 are examples of the ninth process, step S25 is an example of the tenth process, step S21 is an example of the eleventh process, step S23 is an example of the twelfth process and the thirteenth process, step S22 is an example of the fourteenth process, step S23 is an example of the fifteenth process, and step S23 and step S24 are examples of the sixteenth process and the seventeenth process.

[0181] The present embodiment also discloses the following features: For example, the present invention discloses a non-transitory storage medium that stores a computer-readable application communicably connected via a network to a user terminal carried by a user, the non-transitory storage medium storing the application causing the computer to execute the following processes: acquire, from the user terminal, a starting position where the user is located and a destination distant from the starting position; acquire, from the user terminal, images captured after the user has started moving from the starting position; determine whether the user has reached the destination based on the images acquired from the user terminal; acquire, from the user terminal, activity information of the user from the starting position to the destination; and, when it is determined that the user has reached the destination, set a reward to be granted to the user terminal based on the activity information.

[0182] Furthermore, there is provided an information processing method executed by a computer having a processor that executes processing and that is communicatively connected via a network to a user terminal carried by a user, wherein the processor executes the following processes: acquiring from the user terminal the starting position where the user is located and a destination distant from the starting position; acquiring from the user terminal images taken after the user has started moving from the starting position; determining whether the user has reached the destination based on the images acquired from the user terminal; acquiring from the user terminal activity information of the user from the starting position to the destination; and, when it is determined that the user has reached the destination, setting a reward to be granted to the user terminal based on the activity information.

[0183] Furthermore, this embodiment exemplifies an application (program) product including an application (program) that realizes various processes when the application (program) is executed by a processor. The processing unit described in this embodiment can also be defined as a processing circuit, a processor, or a processing means. The management unit can also be defined as a management circuit, a manager, or a management means. The judgment unit can also be defined as a judgment circuit, a judger, or a judgment means. The detection unit can also be defined as a detection circuit, a detector, or a detection means. [Industrial Applicability]

[0184] This embodiment can be used as an information processing device, an information processing system, and an application that combine and use a plurality of images. [Explanation of symbols]

[0185] 10...information processing system, 11...management computer, 13, 13A, 13B...user terminal, 14...processor

Claims

1. An information processing device having a processor that executes processing and that is communicably connected to a user terminal via a network, The processor: a first process for determining whether a start position from which the user carrying the user terminal will start moving has been selected on the user terminal and whether a destination away from the start position has been selected, before the user carrying the user terminal moves on the Earth, by processing information acquired from the user terminal; a second process that, when it is determined that the start position and the destination have been selected on the user terminal, allows the user terminal to perform a combining process of combining a plurality of images including images related to the movement route from the start position to the destination, from the time the user starts moving from the start position until the user reaches the destination; a third process of prohibiting the user terminal from performing the combining process when it is determined that the selection of the start position and the selection of the destination have not been performed on the user terminal; An information processing device configured to execute the above.

2. 2. The information processing device according to claim 1, The processor: a fourth process of determining whether the user has exercised before starting to move from the start position by processing information acquired from the user terminal; Further execute The second process executed by the processor includes: permitting the user terminal to perform the combining process when it is determined that the user has exercised and that the start position and the destination have been selected; The third process executed by the processor is determining that the user did not exercise; or determining that the selection of the starting location and the selection of the destination have not been performed; When one or more of the above determinations are satisfied, the information processing device is configured to prohibit the user terminal from performing the combining process.

3. 2. The information processing device according to claim 1, The processor: a fifth process of generating one or more images to be used for performing a combining process on the user terminal when it is determined that the selection of the start position and the selection of the destination have been performed on the user terminal; a sixth process of not generating one or more images to be used for performing a combining process on the user terminal when it is determined that the selection of the start position and the selection of the destination have not been performed on the user terminal; The information processing device is configured to further execute the above.

4. 2. The information processing device according to claim 1, The processor: a seventh process of acquiring, from the user terminal, an image captured after the user starts moving from the start position; an eighth process of determining whether the user has reached the destination based on an image acquired from the user terminal; a ninth process of acquiring, from the user terminal, activity information of the user from the start position to the destination; a tenth process of setting a reward to be granted to the user terminal based on the activity information when it is determined that the user has reached the destination; The information processing device is configured to further execute the above.

5. 5. The information processing device according to claim 4, The activity information acquired by the processor from the user terminal in the ninth process is the actual number of steps taken by the user after the user has started moving from the starting position; the actual distance traveled by the user after the user has started moving from the starting position; Whether or not the user has answered a quiz question after starting to move from the starting position; The accuracy rate of the answers to the quiz; An information processing device configured to include one or more pieces of information.

6. 2. The information processing device according to claim 1, The processor: an eleventh process of acquiring user information including a hobby of the user from the user terminal before the user starts moving from the start position; and, a twelfth process of providing the user terminal with information on one or more of a destination having a facility related to the user's hobby or a travel route having a facility related to the user's hobby, which information is acquired from the user terminal before the user starts moving from the start position; The information processing device is configured to further execute the above.

7. 2. The information processing device according to claim 1, The processor: a thirteenth process of generating a travel route from the start position to the destination and a quiz related to the user's hobby; a fourteenth process of providing the generated quiz to the user terminal; The information processing device is configured to further execute the above.

8. 10. An information processing system comprising: the information processing device according to claim 1; and goggles communicably connected to the user terminal and worn on the body of the user, The processor: a fifteenth process of sending information on a travel route from the start position to the destination to the user terminal as virtual reality information recognizable by the user wearing the goggles; An information processing system configured to further execute the above.

9. 9. The information processing system according to claim 8, The processor of the information processing device A sixteenth process of generating virtual information at one or more points in time before or after the time when the user actually performed an activity on the route from the start position to the destination; a seventeenth process of sending the generated virtual information to the user terminal; An information processing system configured to further execute the above.

10. An application that causes a computer connected to a user terminal carried by a user via a network to execute a process, The computer, a first process for determining whether a start position from which the user carrying the user terminal will start moving has been selected on the user terminal and whether a destination away from the start position has been selected, before the user carrying the user terminal moves on the Earth, by processing information acquired from the user terminal; a second process that, when it is determined that the start position and the destination have been selected on the user terminal, allows the user terminal to perform a combining process of combining a plurality of images including images related to the movement route from the start position to the destination, from the time the user starts moving from the start position until the user reaches the destination; a third process of prohibiting the user terminal from performing the combining process when it is determined that the selection of the start position and the selection of the destination have not been performed on the user terminal; The application that runs the

Images