Information processing device, information processing system, and application

The system enhances user motivation for walking by determining destinations, displaying travel route images, combining multiple images, and offering rewards, thereby increasing engagement and cognitive stimulation.

JP7594343B1Active Publication Date: 2024-12-04中村 幸恵

Patent Information

Application Number
JP2024087755
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-05-30
Publication Date
2024-12-04
Estimated Expiration
2044-05-30

AI Technical Summary

Technical Problem

Existing information processing systems and applications do not adequately enhance user motivation for walking, despite advancements in visual inspection methods and augmented reality technologies.

Method used

An information processing system and application that includes a management computer and user terminals, utilizing a processor to determine a starting position and destination, display travel route images, and combine multiple images, while rewarding users for reaching destinations and engaging them with quizzes and interactive content.

Benefits of technology

Increases user motivation for walking by providing engaging visual content and rewards, enhancing user interaction and cognitive stimulation through image combination and quiz participation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007594343000001_ABST
    Figure 0007594343000001_ABST
Patent Text Reader

Abstract

To provide an information processing device capable of increasing a user's motivation to walk. [Solution] The management computer 11 has a processor 14, and the processor 14 is configured to execute a first process of determining whether a start position from which a user 21 will begin movement has been selected on the user terminal 13, and whether a destination away from the start position has been selected; a second process of permitting a combining process to be performed on the user terminal 13, when it is determined that the start position and destination have been selected on the user terminal 13, to combine multiple images including images related to the movement path from the start position to the destination, from the time the user 21 begins movement from the start position to after arriving at the destination; and a third process of prohibiting the combining process from being performed on the user terminal 13, when it is determined that the start position and destination have not been selected on the user terminal 13.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to an information processing device, an information processing system, and an application that combine and use a plurality of images. [Background technology]

[0002] Non-Patent Document 1 discloses an example of an information processing device, information processing system, and application that combine and use multiple images. Non-Patent Document 1 discloses that "Memory Graph (Memogram) is a camera application that supports shooting with the same composition. Enjoy photography techniques that visualize changes, such as photos of then and now, before and after photos, fixed point observation photos, and sacred place pilgrimage photos." Non-Patent Document 1 also discloses that "Memory Graph is similar to augmented reality (AR) but is not the same. Photos are overlaid on top of the camera viewfinder, not in the landscape."

[0003] Furthermore, Patent Document 1 describes a visual inspection method. The visual inspection method described in Patent Document 1 is characterized in that "a transparent organic EL display is installed on a window of a moving body facing the inside of the moving body, a camera is installed near the window of the moving body facing the outside of the moving body, and an image previously captured and stored by the camera is projected onto the transparent organic display, so that a person aboard the moving body can see the scenery visible in real time from the window of the moving body superimposed on the image projected onto the transparent organic EL display." [Prior art documents] [Non-patent literature]

[0004] [Non-Patent Document 1] ROIS-DS Humanities Open Data Joint Use Center, Memory Graph, [Retrieved May 15, 2024], Internet<URL:https: / / mp.ex.nii.ac.jp / > [Patent documents]

[0005] [Patent Document 1] JP 2023-027866 A Summary of the Invention [Problem to be solved by the invention]

[0006] The present inventors have recognized that the techniques described in Patent Documents 1 and 2 still have room for improvement in terms of increasing a user's motivation to walk.

[0007] An object of the present disclosure is to provide an information processing device, an information processing system, and an application that can further increase a user's motivation to walk. [Means for solving the problem]

[0008] This embodiment describes an information processing device that has a processor that executes processing and is communicatively connected to a user terminal via a network, and the processor processes information obtained from the user terminal to execute a first process of determining whether or not a start position from which the user holding the user terminal will begin movement has been selected on the user terminal before the user moves on the Earth, and whether or not a destination away from the start position has been selected on the user terminal; a second process of allowing a combination process to be performed on the user terminal, when it is determined that the start position and the destination have been selected on the user terminal, to combine multiple images, including images related to the movement path from the start position to the destination, on the user terminal from the time the user starts moving from the start position to after the user reaches the destination; and a third process of prohibiting the combination process from being performed on the user terminal, when it is determined that the start position and the destination have not been selected on the user terminal. Effect of the Invention

[0009] According to this embodiment, it is possible to further increase the motivation of the user to walk. [Brief description of the drawings]

[0010] [Figure 1A] FIG. 1 is a conceptual diagram showing an example of the configuration of an information management system. [Figure 1B] FIG. 2 is a conceptual diagram showing an example of the configuration of a management computer included in the information management system. [Figure 1C] FIG. 2 is a conceptual diagram showing an example of the configuration of a user terminal included in the information management system. [Diagram 2] 11 is a flowchart illustrating an example of processing performed in the information management system. [Diagram 3] 11 is a conceptual diagram showing an example of an activity screen displayed on a display unit of a user terminal. FIG. [Figure 4] 10 is a conceptual diagram showing an example of a shooting screen displayed on a display unit of a user terminal. FIG. [Diagram 5] 11 is a conceptual diagram showing an example of a screen displayed on a display unit of a user terminal. FIG. [Figure 6] 11 is a conceptual diagram showing an example of a screen displayed on a display unit of a user terminal. FIG. [Figure 7] 11 is a flowchart showing an example of a subroutine executed by the management computer. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] (overview) In this embodiment, an information processing system 10 shown in Fig. 1A is disclosed. The information processing system 10 shown in Fig. 1A includes a management computer 11, a user terminal 13 connected to the management computer 11 via a network 12, and goggles 56. The management computer 11 is managed and operated by an administrator 20, for example, a company or an individual. The user terminal 13 is operated and used by a user 21. The user 21 may be any of an individual, a company, an organization, etc.

[0012] 1A shows a single user terminal 13, but multiple user terminals 13 can be connected to management computer 11 via network 12. That is, user terminals 13 include user terminal 13A used by user 21A and user terminal 13B used by user 21B. User 21B includes a service provider that provides user 21A with a service related to the hobby of user 21A.

[0013] Services related to the hobby of the user 21A are, for example, the following services. If the hobby of the user 21A is appreciating art, the service provider includes an art museum manager. If the hobby of the user 21A is shogi or go, the service provider includes a go club or shogi club manager. If the hobby of the user 21A is running, the service provider includes a running facility manager. If the hobby of the user 21A is watching movies, the service provider includes a movie theater manager.

[0014] The user 21A and the user 21B are different persons. The number of users 21 may be three or more, and the number of user terminals 13 may be three or more. In this embodiment, several specific examples of the management computer 11 are disclosed, several specific examples of the user terminals 13 are disclosed, and several specific examples of the applications are disclosed.

[0015] (Administrative computer) 1B is a computer equipped with a main body (casing), a processor 14, a main memory 15, an auxiliary memory 16, a communication interface 17, etc. The processor 14 is provided inside the main body and is composed of a central processing unit (CPU (Central Processing Unit)) that integrates an arithmetic unit (arithmetic circuit) and a control unit (control circuit). The processor 14 is communicatively connected to the main memory 15, the auxiliary memory 16, and the communication interface 17 via a bus 18.

[0016] The processor 14 executes applications to comprehensively control other devices and circuits provided inside the main body and devices and circuits provided outside the main body. The processor 14 executes applications to process information obtained from the auxiliary memory 16 and information obtained from the user terminal 13. The processes performed by the processor 14 include calculation, judgment, comparison, control, etc. The processes executed by the processor 14 include addition, modification, and update of information stored in the auxiliary memory 16. The non-transient applications executed by the processor 14 include those stored in the auxiliary memory 16 and those obtained from the external device 19 via the network 12. The external device 19 includes a communication base, various computers, etc.

[0017] The information processed by the processor 14 includes data, images, map information, user information, activity information of the user 21, etc. Images include photographs, still images, videos, illustrations, animations, etc. Map information is a diagram in which a part or all of the earth is represented using symbols and characters by reducing or transforming it. Map information may be either two-dimensional information or three-dimensional information, and characters may be in any language of the world. Furthermore, the language can be changed arbitrarily. Furthermore, map information includes auxiliary information such as the history, buildings, products, and events of each country, region, and point, as well as the longitude and latitude of each point.

[0018] The user information is information about the user 21 who uses the application. The user information includes, for example, the name, date of birth, sex, address, email address, hobbies, preferences, things of interest, countries to visit, cities and regions to visit, password, fee plan, phone number, etc. The activity information and fee plan of the user 21 will be described later.

[0019] The main memory 15 is a volatile storage device, and functions as a work area and a buffer area when the processor 14 executes processing. The auxiliary memory 16 is a non-volatile, i.e., non-transient storage device, and non-transient applications are stored in the auxiliary memory 16. The auxiliary memory 16 has a larger capacity than the main memory 15, and operates according to input commands and output commands from the processor 14.

[0020] The auxiliary memory 16 includes, for example, a magnetic disk, an optical disk, a flash memory, etc. An example of a magnetic disk is a hard disk drive, and an example of an optical disk is a compact disk, a digital video disk, a Blu-ray disk, etc. A flash memory is a type of semiconductor memory, and examples of the flash memory include an SD memory card, a USB flash drive, a solid state drive, etc. At least one element included in the auxiliary memory 16 can be understood as a non-transitory storage medium 16A in which non-transitory applications and various information are stored and which is computer-readable.

[0021] The auxiliary memory 16 stores applications executed by the processor 14, information before being processed by the processor 14, information resulting from processing by the processor 14, information used for processing, judgment, machine learning, automatic generation, etc. of the artificial intelligence unit 28, learning data, etc. The information before being processed by the processor 14 and the information resulting from processing by the processor 14 include images, map information, user information, user activity information, etc. Images include photographs, still images, videos, illustrations, animations, etc.

[0022] The communication interface 17 includes devices, equipment, and standards that connect the management computer 11 to the network 12 by at least one of a wireless communication system and a wired communication system. Devices and equipment that connect the management computer 11 to the network 12 include cables, antennas, routers, etc. The network 12 includes an internetwork, a personal area network, a local area network, a campus area network, etc. The management computer 11 obtains information sent from the user terminal 13 and external devices 19 via the communication interface 17. The management computer 11 transmits information to be sent to the user terminal 13 and external devices 19 via the communication interface 17.

[0023] The processor 14 is configured to load and execute non-transient applications to function as a website management unit 22, a user information processing unit 23, an acquired information processing unit 24, a provided information processing unit 25, a map information processing unit 26, a determination unit 27, an artificial intelligence unit 28, and a reward processing unit 29. The website management unit 22 manages websites published on the network 12, information on services provided on the websites, usage screens provided to the user terminal 13, and the like.

[0024] The user information processing unit 23 processes and manages user information acquired from the user terminal 13, manages accounts assigned to each user 21, stores the results of processing the user information in the auxiliary memory 16, manages and updates the history of the user information stored in the auxiliary memory 16, processes and manages activity information of the user 21 acquired from the user terminal 13, etc. The user information processing unit 23 also realizes an environment in which the user terminal 13A and the user terminal 13B can converse with each other and share information with each other.

[0025] The acquired information processing unit 24 processes various types of information acquired from the user terminal 13 and the external device 19, and stores the processing results in the auxiliary memory 16. The various types of information processed by the acquired information processing unit 24 may include a part or all of the user information, and may include a part or all of the activity information of the user 21. The various types of information processed by the acquired information processing unit 24 include audio information, image information, etc. The provided information processing unit 25 executes a process of providing the various types of information processed by the processor 14 and the information stored in the auxiliary memory 16 to the user terminal 13 and the external device 19.

[0026] In addition, the provided information processing unit 25 has the function of generating, based on the starting position, destination, user information obtained from the user terminal 13, and information stored in the auxiliary memory 16, information on the travel route from the starting position to the destination and notable facilities in the surrounding area, information on events and history, the location and number of checkpoints on the travel route, quizzes that are likely to interest the user 21, and quizzes related to the travel route from the starting position to the destination.

[0027] The map information processing unit 26 manages the map information stored in the auxiliary memory 16, updates the map information in the auxiliary memory 16 based on information obtained from the external device 19, processes the map information to be provided to the user terminal 13, and so on.

[0028] The reward processing unit 29 sets a reward to be given to the user terminal 13 based on the activity information of the user 21. The reward includes crypto assets (virtual currency), points, etc. The activity information of the user 21 includes, for example, the number of times the user 21 reaches a destination, the number of steps taken by the user 21, the distance traveled by the user 21, whether or not a quiz has been answered, the accuracy rate of the answers to the quiz, etc.

[0029] The reward processing unit 29 sets the points to be awarded relatively more as the number of times the user 21 reaches the destination relatively increases. The reward processing unit 29 sets the points to be awarded relatively more as the number of steps taken by the user 21 increases relatively. The reward processing unit 29 sets the points to be awarded relatively more as the distance traveled by the user 21 increases relatively. The reward processing unit 29 awards points when there is an answer to the quiz, and does not award points when there is no answer to the quiz. The reward processing unit 29 sets the points to be awarded relatively more as the rate of correct answers to the quiz is relatively higher. The determination unit 27 executes a process of determining whether the user 21 has reached the destination, a process of storing the determination result in the auxiliary memory 16, and a process of sending the determination result to the user terminal 13.

[0030] The artificial intelligence unit 28 has a function of creating history data and update data of the various information stored in the auxiliary memory 16 based on the various information acquired by the management computer 11, the various information stored in the auxiliary memory 16, and learning data, and storing the created data in the auxiliary memory 16. In addition, the artificial intelligence unit 28 automatically generates various information to be proposed to the user terminal 13 based on the user information and activity information of the user 21, and stores it in the auxiliary memory 16.

[0031] The artificial intelligence unit 28 is an artificial intelligence (AI) equipped with transformers including GPT (Generative Pre-trained Transformer), BERT (Bidirectional Encoder Representations from Transformers), etc., and language models such as recurrent neural networks, and is capable of performing processing as generative artificial intelligence.

[0032] The language model is an example of a learning model based on a machine learning algorithm. Specific examples of machine learning algorithms include nearest neighbor methods, naive Bayes methods, decision trees, support vector machines, and deep learning using neural networks. The artificial intelligence unit 28 can apply the above algorithms as appropriate.

[0033] The artificial intelligence unit 28 may also have a trained model constructed by a learning method such as supervised learning, unsupervised learning, or self-supervised learning. In supervised learning, machine learning is performed using training data including training data. The training data is composed of a pair of input data for learning and output data including correct answer data. The language model includes a model trained for a specific task and a general-purpose model that can be used for a wide range of tasks.

[0034] The artificial intelligence unit 28 has a function of automatically generating a trained model by performing machine learning, for example, deep learning using a neural network, based on various information and data stored in the auxiliary memory 16 and information and data newly acquired from the user terminal 13 and the external device 19. The automatically generated trained model is stored in the auxiliary memory 16. The artificial intelligence unit 28 has a function of automatically extracting an image of a route from the current position to the destination based on map information and information acquired from the user terminal 13. The artificial intelligence unit 28 has a function of automatically generating an image related to the hobby of the user 21.

[0035] (User terminal) The user terminal 13 shown in Fig. 1C is a portable computer that can be carried and moved by the user 21, for example, the user 21 can walk outdoors, the user 21 can move on a bicycle, the user 21 can move using public transportation, etc. The user terminal 13 includes, for example, a smartphone, a tablet terminal, a digital camera, a laser scanner, etc. The digital camera includes a single-lens reflex camera. The user terminal 13 includes a main body (casing), a processor 30, a main memory 31, an auxiliary memory 32, an operation unit 33, a display unit 34, an image acquisition unit 35, a microphone 36, a speaker 37, a communication interface 38, etc.

[0036] The processor 30 is provided inside the main body and is configured by a central processing unit (CPU (Central Processing Unit)) in which an arithmetic unit (arithmetic circuit) and a control unit (control circuit) are integrated. The processor 30 is communicably connected to the main memory 31, the auxiliary memory 32, the operation unit 33, the display unit 34, the image acquisition unit 35, the microphone 36, the speaker 37, and the communication interface 38 via a bus 39. The processor 30 processes signals, information, and data input from other devices and circuits provided inside the main body by executing an application, and processes signals, information, and data input from devices and circuits provided outside the main body. The processor 30 also controls other devices and circuits provided inside the main body and controls devices and circuits provided outside the main body by executing an application.

[0037] The application may be any of a web app used on a web browser, a native app installed in the user terminal 13, and a hybrid app having properties of both a web app and a native app. The processor 30 executes the application to process information obtained from the auxiliary memory 32 and information obtained from the management computer 11. The processing performed by the processor 30 includes calculation, judgment, comparison, control, and the like.

[0038] The processes executed by the processor 30 include adding, changing, updating, and the like of information stored in the auxiliary memory 32. The non-transient applications executed by the processor 30 include those stored in the auxiliary memory 32 and those obtained from the management computer 11. The information processed by the processor 30 includes images, various data, map information, user information, activity information of the user 21, and the like. The images include photographs, still images, videos, illustrations, animations, and the like.

[0039] The main memory 31 is a volatile storage device, and functions as a work area and a buffer area when the processor 30 executes processing. The auxiliary memory 32 is a non-volatile, i.e., non-transient storage device, and non-transient applications are stored in the auxiliary memory 32. The auxiliary memory 32 has a larger capacity than the main memory 31, and operates in response to input commands and output commands from the processor 30.

[0040] The auxiliary memory 32 includes, for example, a magnetic disk, an optical disk, a flash memory, etc. An example of a magnetic disk is a hard disk drive, and an example of an optical disk is a compact disk, a digital video disk, a Blu-ray disk, etc. A flash memory is a type of semiconductor memory, and examples of the flash memory include an SD memory card, a USB flash drive, a solid state drive, etc. At least one element included in the auxiliary memory 32 can be understood as a non-transitory storage medium 32A in which non-transitory applications and various information are stored and which is computer-readable.

[0041] The auxiliary memory 32 stores applications executed by the processor 30, information before being processed by the processor 30, information resulting from processing by the processor 30, etc. The information before being processed by the processor 30 and the information resulting from processing by the processor 30 include images, map information, user information, activity information of the user 21, etc. Images include photographs, still images, videos, illustrations, animations, etc.

[0042] The operation unit 33 is operated by the user 21. The user 21 can operate the operation unit 33 to input various information and data to the user terminal 13, input selection instructions of the user 21, issue operation instructions to the user terminal 13, and the like. The operation unit 33 includes, for example, various operation buttons for operating the user terminal 13, a shutter button for taking a photograph with the user terminal 13, and the like. The information and data input to the user terminal 13 by operating the various operation buttons includes, for example, images, characters, numbers, sentences, symbols, and the like.

[0043] The display unit 34 is a device that outputs various information and data in a state that can be visually confirmed by the user 21. The display unit 34 includes, for example, a liquid crystal display, an organic EL display, etc. Note that various operation buttons and a shutter button may be displayed on various screens displayed on the display unit 34. In other words, the display unit 34 may also serve as the operation unit 33.

[0044] The microphone 36 is a device that acquires the voice of the user 21 and sounds around the user terminal 13, and converts the acquired sounds into electrical signals. The speaker 37 is a device that outputs the sound information acquired from the management computer 11, the sounds processed by the processor 30, and the sounds acquired by the microphone 36 to the space around the user terminal 13.

[0045] The image acquisition unit 35 is a device that captures images of the scenery, landscapes, buildings, people including the user 21, animals, and the like around the user 21 who owns the user terminal 13 to acquire images. When the user terminal 13 is a smartphone or a tablet terminal, the image acquisition unit 35 functions as a so-called camera. The image acquisition unit 35 functioning as a camera has a lens, a mirror, an optical finder, an image sensor, an image processing engine, and the like. When the user terminal 13 is a laser scanner, the image acquisition unit 35 has a light source, a lens, a mirror, an optical finder, an image sensor, an image processing engine, and the like. The image acquisition unit 35 may be provided directly on the main body of the user terminal 13, or the image acquisition unit 35 may be connected to the main body of the user terminal 13 via a wireless communication interface or a wired communication interface.

[0046] The communication interface 38 includes devices, equipment, and standards for connecting the user terminal 13 to the network 12 and artificial satellites via at least one of a wireless communication system and a wired communication system. The communication interface 38 includes cables, antennas, routers, etc. The network 12 includes an internetwork, a personal area network, a local area network, a campus area network, etc. The user terminal 13 obtains information sent from the management computer 11 and external device 19 and signals from artificial satellites via the communication interface 38. The user terminal 13 outputs information to be sent to the management computer 11 and external device 19 via the communication interface 38.

[0047] The processor 30 is configured to load and execute non-temporary applications to function as an acquired information processing unit 40, a transmitted information processing unit 41, a map information processing unit 42, a position detection unit 43, a traveled distance detection unit 44, and a step count detection unit 45. The acquired information processing unit 40 processes various information acquired from the management computer 11 and the external device 19, and stores the processing results in the auxiliary memory 32. The transmitted information processing unit 41 sends the information processed by the processor 30 and the information stored in the auxiliary memory 32 to the management computer 11.

[0048] The map information processing unit 42 processes map information acquired from the management computer 11 and the external device 19, stores the map information in the auxiliary memory 32, updates the map information in the auxiliary memory 32, and performs other functions. The position detection unit 43 is, for example, configured with a GPS (Global Positioning System), processes signals received from four or more artificial satellites, and performs the following functions by referring to the map information. The position detection unit 43 has a function of detecting the position of the user terminal 13 in the map information, that is, the current position of the user terminal 13. The current position of the user terminal 13 is synonymous with the current position of the user 21. In addition, the position detection unit 43 detects the actual movement route of the user terminal 13 from the current position of the user terminal 13 to the destination, and stores the detection result in the auxiliary memory 32.

[0049] The travel distance detection unit 44 has a function of detecting the travel distance of the user 21 within a predetermined time, the travel distance from the starting position, etc., using information such as the current position of the user terminal 13 in the map information and roads shown in the map information. The step count detection unit 45 detects the number of steps of the user 21 within a predetermined time, the number of steps from the starting position, etc., by processing a signal from an acceleration sensor or a signal from a pendulum sensor provided in the user terminal 13.

[0050] (Goggles explanation) The goggles 56 are connected to the user terminal 13 so as to be able to communicate with each other. The goggles 56 include a main body, a right-eye camera 57 and a left-eye camera 58, a right-eye display 59 and a left-eye display 60, a speaker 61, a microphone 62, a sensor 63, a communication interface 64, a processor 65, a memory 66, and the like. The main body is worn on the head of the user 21, and the right-eye camera 57 and the left-eye camera 58, the right-eye display 59 and the left-eye display 60, the speaker 61, the microphone 62, the sensor 63, the communication interface 64, and the processor 65 are provided in the main body. The sensor detects the amount of movement of the main body, the direction in which the main body is moved, and the like.

[0051] The processor 65 is communicatively connected to the right-eye camera 57 and the left-eye camera 58, the right-eye display 59 and the left-eye display 60, the speaker 61, the microphone 62, the sensor 63, and the communication interface 64. Images captured by the right-eye camera 57 and the left-eye camera 58 of the goggles 56 are processed by the processor 65. Information processed by the processor 65 is sent to the user terminal 13 via the communication interface 64. Information sent from the goggles 56 to the user terminal 13 is sent to the management computer 11.

[0052] Furthermore, the goggles 56 can display images included in the information acquired from the user terminal 13 on a right-eye display 59 and a left-eye display 60. Virtual reality (VR) images and augmented reality (AR) images can be displayed on the right-eye display 59 and the left-eye display 60. The goggles 56 can also output audio information included in the information acquired from the user terminal 13 from a speaker 61. The user 21 can wear the goggles 56 and explore places around the world while viewing virtual reality (VR) images and augmented reality (AR) images. Furthermore, the right-eye camera 57 and the left-eye camera 58 can take pictures of images included in virtual reality (VR) and augmented reality (AR).

[0053] Furthermore, the artificial intelligence unit 28 of the management computer 11 can generate virtual information including images and sounds from a time point before (past) the actual activity and images and sounds from a time point after (future) the actual activity, in addition to images from the time point of the actual activity, for the moving route and destination selected by the user 21 and actually active, by generative artificial intelligence. The virtual information generated by the artificial intelligence unit 28 can be sent from the management computer 11 to the user terminal 13. The goggles 56 utilizes the virtual information provided to the user terminal 13 by the management computer 11 in steps S23 and S24. Images are displayed on the right eye display 59 and left eye display 60 of the goggles 56, and sounds are output from the speaker 61.

[0054] (Explanation of information processing method) FIG. 2 shows an example of an information processing method performed in the information processing system 10.

[0055] (1) Processing performed on the user terminal In step S10, the user terminal 13 is connected to the website of the network 12. Then, a registration procedure screen is displayed on the display unit 34 of the user terminal 13. The registration procedure screen includes menus such as "Enter user information", "Register", and "Click here if already registered". When the user 21 selects "Enter user information", the user can enter user information. If the user 21 is an individual, the user information includes the user's name, date of birth, sex, address, email address, hobbies, preferences, matters of interest, password, fee plan, telephone number, the user's hobbies, and the like. Also, if the user 21 is a company or organization, the user information includes the name, address, email address, password, fee plan, telephone number, services and products provided by the company or organization, and the like of the company or organization.

[0056] Furthermore, when "Register" is selected in step S10, the entered user information is sent from the user terminal 13 to the management computer 11. Then, the user information is registered in the management computer 11, and an account is assigned to the user. The user terminal 13 obtains the account from the management computer 11. In step S11, the user 21 selects "Click here if already registered" on the registration procedure screen described above, enters the account and password, and sends them to the management computer 11.

[0057] Then, the user terminal 13 can execute the application provided by the management computer 11 from step S12 onwards. When the application is executed, a selection screen is displayed on the display unit 34. On the selection screen, destination candidates can be displayed from sacred site pilgrimages, history, movies, anime, dramas, people's names, hobbies registered by the user, etc. The user 21 operates the user terminal 13 to select one of the destination candidates by specifying the travel distance, number of steps, required time, etc.

[0058] Furthermore, in step S12, the means of transportation (course) from the current position to the destination can be displayed on the selection screen of the display unit 34. For example, brisk walking, wheelchair, guide dog / pet, bicycle, etc. are displayed as the means of transportation. The user 21 can select any of the means of transportation by operating the user terminal 13. When the means of transportation is selected, candidates for destinations that are compatible with the selected means of transportation are displayed.

[0059] In step S12, the user 21 can also specify and select the current location, destination, distance traveled, number of steps, required time, etc., by voice input using the microphone 36. Then, when the user 21 operates the user terminal 13 to select items such as the current location, destination, distance traveled, number of steps, required time, etc., of the user 21, the selected items are sent from the user terminal 13 to the management computer 11.

[0060] When a required item is selected on the selection screen, an activity screen 46 as shown in Fig. 3 is displayed on the display unit 34. The activity screen 46 displays the current location of the user terminal 13, specifically a map from the starting position to the destination, potential travel routes from the starting position to the destination, and the like. The current location of the user 21 is detected by the position detection unit 43 of the user terminal 13. The user 21 can also operate the operation unit 33 to input the current location on the map. Furthermore, in addition to the modern map, the map from the starting position to the destination can also display a past map by setting a time period.

[0061] Additionally, an audio guide button 47, a photo taking button 48, etc. are displayed on the activity screen 46. The acquired information processing unit 40 processes the operation contents of the audio guide button 47 and the photo taking button 48. The microphone 36 outputs a sound corresponding to the operation of the audio guide button. The image acquiring unit 35 performs processing and operations corresponding to the operation of the photo taking button 48.

[0062] The user 21 carries the user terminal 13, and starts moving from the current location to the destination in step S13. The user terminal 13 is, for example, a smartphone or a tablet terminal. The moving route and intermediate positions of the user 21 from when the user starts moving from the current location to when the user reaches the destination are detected by the position detection unit 43. The moving route and intermediate positions of the user 21 are sent from the user terminal 13 to the management computer 11.

[0063] Furthermore, the user 21 can operate the photo taking button 48 on the activity screen 46 during the time from the current location to the destination. Then, a photo taking screen is displayed on the display unit 34. Various types of photo taking can be performed on the photo taking screen 49. Images taken by the image taking unit 35 during the time from the current location to the destination of the user 21 are stored in the auxiliary memory 32 of the user terminal 13. Furthermore, the images taken by the image taking unit 35 are sent from the user terminal 13 to the management computer 11.

[0064] Furthermore, when the photographing button 48 on the activity screen 46 is operated, a photographing screen 49 as shown in FIG. 4 is displayed on the display unit 34. When the shutter button is operated while the photographing screen 49 is displayed, a photograph of the image displayed on the photographing screen 49 is taken. Furthermore, the photographing screen 49 can be divided into a first area 50 and a second area 51 by operating the operation button on the operation unit 33. The respective positions of the first area 50 and the second area 51 can be changed arbitrarily. For example, the first area 50 and the second area 51 may be arranged side by side, left and right, or up and down, in FIG. 4. Furthermore, the first area 50 may be arranged inside the second area 51, or the second area 51 may be arranged inside the first area 50.

[0065] FIG. 4 shows an example in which the first region 50 is disposed inside the second region 51. Furthermore, the respective outer peripheral shapes of the first region 50 and the second region 51 can be changed arbitrarily. For example, the respective outer peripheral shapes of the first region 50 and the second region 51 may be any of a rectangle, a circle, an ellipse, a trapezoid, a triangle, and the like. Furthermore, the respective areas of the first region 50 and the second region 51, that is, the angles of view, can be changed. Also, either the first region 50 or the second region 51 can be made semi-transparent on the shooting screen.

[0066] Then, the user 21 can obtain a "new image" by operating the shutter button of the operation unit 33 on the shooting screen 49. The "new image" is a combination of a "basic image" and an "additional image". For example, as the "basic image", an object in an actual location around the user terminal 13 during the user 21's activity, such as a building, a landscape, a person, etc., can be selected. An "additional image" is an image that the user 21 intends to add to the "basic image". As the "additional image", for example, a photograph taken in the past, an animated image, etc. can be selected. Note that the technical meanings of the "basic image" and the "additional image" may be reversed from those described above.

[0067] Furthermore, the user 21 can operate the operation unit 33 to place the first area 50 inside the second area 51 and make the first area 50 semi-transparent. Also, a landscape photo taken in the past can be placed in the second area 51 as an "additional image". The "additional image" is stored in the auxiliary memory 32. Then, with the "basic image" placed in the first area 50, a photograph can be taken to obtain a "new image". Furthermore, the location where the "basic image" was taken can be the same as the location of the landscape photo in the "additional image".

[0068] Then, in step S14, the "new image" acquired by the image acquisition unit 35 is stored in the auxiliary memory 32 of the user terminal 13, and is also sent from the user terminal 13 to the management computer 11. If the user 21 is present in the "basic image", the acquired information processing unit 40 can also dress the image of the user 21 in a cosplay costume or the like using an AR (virtual reality) effect filter.

[0069] Furthermore, actual movement information detected from the time when the user 21 starts moving from the starting position toward the destination, specifically, the date and time, until the user 21 reaches the destination, is stored in the auxiliary memory 32 of the user terminal 13. The actual movement information is also sent from the user terminal 13 to the management computer 11. The actual movement information includes, for example, the actual movement route, the actual time required, the actual number of steps, the actual movement distance, etc. The process performed by the user terminal 13 in step S14 is realized by utilizing an application provided by the management computer 11.

[0070] In step S15 following step S14, the user terminal 13 acquires the judgment result and the points from the management computer 11. The user terminal 13 stores the acquired judgment result and points in the auxiliary memory 32. The judgment result is a judgment result as to whether or not the user 21 has reached the destination. The meaning of the points will be described later.

[0071] (Processing performed on the management computer) In step S20, the management computer 11 publishes a website on the network 12. When the management computer 11 acquires user information from the user terminal 13 in step S21, it registers the user and assigns an account to identify and specify the registered user 21. The management computer 11 stores the user information and account processed in step S21 in the auxiliary memory 16, and sends the account to the user terminal 13.

[0072] After step S21, when an account and password are input on the "registration procedure screen" of the user terminal 13, the management computer 11 proceeds to step S22 and realizes an environment in which the application can be used on the user terminal 13. Specifically, a usage screen and the like are provided from the management computer 11 to the user terminal 13. This enables the user terminal 13 to obtain various information from the usage screen displayed on the display unit 34 and to send various information to the management computer 11.

[0073] In step S23 following step S22, the management computer 11 acquires the information sent from the user terminal 13 in steps S12 and S13, processes the acquired information, and stores it in the auxiliary memory 16. Furthermore, in step S23, the management computer 11 provides the user terminal 13 with various types of information that can be used by the user terminal 13 and the goggles 56 from the time a destination or the like is set in the user terminal 13 until the user 21 arrives at the destination.

[0074] In step S24, the determination unit 27 of the management computer 11 processes the photographic image, actual movement information, and the like acquired from the user terminal 13 to determine whether or not the user 21 has reached the destination. The management computer 11 also stores the determination result of step S24 in the auxiliary memory 32. Reference information used to determine whether or not the user 21 has reached the destination is stored in the auxiliary memory 32. This reference information includes a standard range of time required from the start position of the user 21 to the destination, a standard range of steps, a standard range of movement distance, a standard image taken at the destination, and the like.

[0075] The management computer 11 determines that "user 21 has reached the destination" when one or more of the following conditions are met: the current location of user 21 is at the destination in the map information (map data), the actual time required is within a standard time range, the actual number of steps is within a standard number of steps, the actual distance traveled is within a standard distance range, and an image of user 21 taken at the destination is included as part of the "new image." The management computer 11 determines that "the user has not reached the destination" when only one of the conditions is met.

[0076] The management computer 11 sends the result of the determination in step S24 to the user terminal in step S25. Furthermore, if the management computer 11 determines in step S24 that the user 21 has reached the destination, then in step S25 it awards points to the user terminal 13 and stores the result of the determination that the user 21 has reached the destination in the auxiliary memory 32. Furthermore, in step S25, the management computer 11 sends to the user terminal 13 the result of the determination that the user 21 has reached the destination and the fact that points have been awarded to the user 21.

[0077] While the user terminal 13 is performing the processes from step S12 to step S14, the management computer 11 can execute the process of step S23 to send various information to the user terminal 13. The various information includes information on the start position and its surroundings, the moving route and notable facilities in the surroundings, information on events and history, checkpoints and quizzes, etc. The user 21 answers quizzes given at checkpoints from step S12 to step S14, and the actual number of steps traveled and points are added. Furthermore, by thinking about the answers to the quizzes, the user 21 can expect to prevent a decline in cognitive function.

[0078] Furthermore, by operating the audio guide button 47, audio guide can be output from the speaker 37 and a text-format explanation can be displayed on the display unit 34. The user 21 can select the voice for the audio guide from among male, female, animation characters, celebrities, etc. The user 21 can select the text-format explanation from among multiple languages.

[0079] (Additional Processing) The user terminal 13 can obtain various information from the usage screen displayed on the display unit 34 in step S12, and can send the various information to the management computer 11. Furthermore, the usage screen provided to the user terminal 13 in step S22 can be displayed on the display unit 34 at any timing as long as the user terminal 13 is logged in to the management computer 11. In other words, the timing of steps S12 and S22 is not limited. Furthermore, if the user terminal 13 is logged in to a website, the management computer 11 provides the user terminal 13 with various information used by the user terminal 13 and the goggles 56 in steps S23 and S24.

[0080] (Explanation of pricing plans) The fee plans for using applications on the user terminal 13 include, for example, a basic plan, a paid membership, and a business membership.

[0081] The basic plan is provided free of charge, for example. The basic plan can realize the following functions: a function of receiving points according to the actual number of steps taken, a function of allowing the user terminal 13 to obtain various information, such as images and materials, from the management computer 11, a function of obtaining guide voice and explanations in text format, and a function of obtaining VR images.

[0082] Paid membership is offered for, for example, 500 yen per month. Paid membership can realize the functions of the basic plan as well as the functions of the professional tool. The function of the professional tool is a function that allows the user terminal 13B to obtain, under specified conditions, various information and data obtained from the user terminal 13A and stored in the auxiliary memory 16 from the management computer 11. The specified condition is, for example, that the user 21A is not personally identified.

[0083] A business membership is provided for a monthly fee of, for example, 1,500 yen. In addition to the functions of the basic plan and the functions of professional tools, the business membership can realize a sponsorship function and a company's own service guidance function. The sponsorship function is a function in which a company, for example, a manufacturer that provides shoes used by the user 21A for walking, or a user 21B that is a manufacturer that provides a camera used by the user 21A, supports sports, cultural and artistic activities, events, etc. by providing money, goods, and people. The company's own service guidance function is a function in which various information provided from the management computer 11 to the user terminal 13A includes a map showing the location of the company or organization that owns the user terminal 13B, and includes information on the company's own services in text format.

[0084] (Application examples) The application executed on the user terminal 13 can realize the following first, second, third and fourth functions regardless of whether the user terminal 13 is a portable computer or a fixed computer. The fixed user terminal 13 includes a desktop computer and a notebook computer.

[0085] (First function) The application executed on the user terminal 13 can realize a function of arranging a basic image and an additional image side by side, one above the other, or one side by side, on the display unit 34. The application executed on the user terminal 13 can realize a function of arranging a basic image 52 and an additional image (including animation) 53 on top of each other on the display unit 34, as shown in Fig. 5, gradually changing the basic image 52 over time, and finally switching to the additional image 53 to be displayed on the display unit 34. Conversely, the additional image 53 may be gradually changed over time, and finally switched to the basic image 52 to be displayed on the display unit 34.

[0086] (Second function) 5, the application executed on the user terminal 13 can realize a function of arranging the additional image 53 on the display unit 34 so as to be superimposed on the basic image 52, and switching from the additional image 53 to the basic image 52 when the user 21 slides the display unit 34 with his / her finger. Also, a function of arranging the basic image 52 on the additional image 53 so as to be superimposed on the display unit 34, and switching from the basic image 52 to the additional image 53 when the user 21 slides the display unit 34 with his / her finger can be realized.

[0087] (Third Function) The application executed on the user terminal 13 can realize a function of arranging the additional image 53 on the display unit 34 so as to be superimposed on the basic image 52, and when the user 21 rubs the display unit 34 with his / her finger, a part of the additional image 53 arranged on top peels off, making the basic image 52 underneath visible. Also, a function of arranging the basic image 52 on the additional image 53 so as to be superimposed on the display unit 34, and when the user 21 rubs the display unit 34 with his / her finger, a part of the basic image 52 arranged on top peels off, making the additional image 53 underneath visible.

[0088] (Fourth Function) Fig. 6 is another example of a screen displayed on the display unit 34. The application executed on the user terminal 13 can realize a function of arranging a basic image 52 and an additional image 53, which are images of the same person taken in the same posture and the same size, side by side on the display unit 34, and displaying a plurality of vertical grid lines 54 on each of the basic image 52 and the additional image 53, and displaying a plurality of horizontal grid lines 55 on each of the basic image 52 and the additional image 53. Fig. 6 shows an example in which the basic image 52 and the additional image 53 are arranged side by side on the display unit 34. This makes it possible to clearly see, for example, changes in the body shape of the same person.

[0089] (Subroutine that can be executed on the management computer) The processor 14 of the management computer 11 can execute the subroutine of FIG. 7 in combination with the control example of FIG. 2. In step S30, the management computer 11 acquires various information from the user terminal 13. In step S31, the management computer 11 determines whether "the user 21 performed the advance exercise on a specified date." Since the image acquisition unit 35 of the user terminal 13 has a camera function, the user 21 can take an image of himself exercising. The user terminal 13 can send an image of the user 21 exercising to the management computer 11. The image sent from the user terminal 13 to the management computer 11 is accompanied by auxiliary information such as the date when the image of the user 21 exercising was taken.

[0090] If the management computer 11 judges Yes in step S31, it judges whether "a destination was selected in the user terminal 13 on the date on which the user 21 previously exercised." If the management computer 11 judges Yes in step S32, it proceeds to step S33, and permits the user terminal 13 to perform the first to fourth functions.

[0091] In step S34 following step S33, the management computer 11 determines whether "the user 21 arrived at the destination on the date on which the user 21 previously exercised." The management computer 11 can make the determination in step S34 in the same manner as the determination in step S24 in FIG. 2.

[0092] If the management computer 11 judges Yes in step S34, then in step S35 the artificial intelligence unit 28 can automatically generate a basic image and an additional image related to the hobby of the user 21. The management computer 11 provides at least one of the generated images to the user terminal 13 in step S35 and ends the routine of Fig. 7. On the other hand, if the management computer 11 judges No in step S34, the artificial intelligence unit 28 does not generate a basic image and an additional image related to the hobby of the user 21 and ends the routine of Fig. 7.

[0093] If management computer 11 judges No in step S31 or judges No in step S32, it executes the process of step S37 and ends the routine of Fig. 7. In step S37, management computer 11 prohibits user terminal 13 from performing the first to fourth functions. Note that management computer 11 may omit the judgment of step S31 in Fig. 7.

[0094] (Other application examples) Application example 1 A laser scanner is lent to a user 21 as a user terminal 13 from an administrator 20 of the management computer 11. The laser scanner acquires position information of an object in a three-dimensional space by irradiating a laser light. The laser scanner can acquire a large amount of point cloud data from a position away from the object without contact and without a prism. That is, the laser scanner can acquire point cloud coordinates (point cloud data) in a three-dimensional space. The user 21 uses the laser scanner to collect various information and data from the start of movement at a start position until the destination is reached. The collected information and data are sent from the user terminal 13 to the management computer 11. The acquired information processing unit 24 of the management computer 11 executes a process of paying a purchase fee for the data to the user terminal 13 that collected the various information and data. In addition, the acquired information processing unit 24 of the management computer 11 sets the purchase fee according to the amount and quality of the various information and data. For example, the purchase fee is set relatively higher as the amount of the various information and data is relatively larger or the quality of the various information and data is higher.

[0095] Application example 2 The goggles 56 can display images included in the information acquired from the user terminal 13 on a right-eye display and a left-eye display. The goggles 56 can also output audio information included in the information acquired from the user terminal 13 from a speaker. The provided information processing unit 25 realizes a function of providing the information on the network 12 to allow a plurality of user terminals 13 to share the photos. The artificial intelligence unit 28 incorporates a function of automatically processing the images acquired from the user terminal 13 to bring out their beauty.

[0096] Application example 3 The reward processing unit 29 of the management computer 11 performs processing to give rewards according to the distance actually walked by the user 21 and the environmentally friendly behavior, and realizes a function to transmit the rewards to the user terminal 13. This encourages the user 21 to have a healthy lifestyle and sustainable behavior.

[0097] Application example 4 The artificial intelligence unit 28 of the management computer 11 learns the preferences and interests of the user 21, and proposes individually customized travel route candidates and content to the user terminal 13. The artificial intelligence unit 28 of the management computer functions as an AI assistant that processes the voice of the user 21 and realizes natural dialogue by utilizing voice recognition technology.

[0098] The judgment unit 27 of the management computer 11 processes the voice information and image information acquired from the user terminal 13 to determine whether the user 21 has encountered an unknown place or an unknown creature. The artificial intelligence unit 28 of the management computer 11 automatically generates support information to support the actions of the user 21 when the user 21 encounters an unknown place or an unknown creature. The support information includes, for example, route guidance from the unknown place to a place where public transportation can be used, route guidance from the unknown place to the nearest station, the ecosystem of the unknown creature, activity habits of the unknown creature, and the like. The information automatically generated by the artificial intelligence unit 28 is provided from the management computer 11 to the user terminal 13.

[0099] Application example 5 The artificial intelligence unit 28 of the management computer 11 automatically generates a story of the virtual world or space according to the tastes and interests of the user 21. It analyzes history information of the user 21, such as the actions, destinations, and travel routes, and automatically generates content that the user 21 finds attractive. The provided information processing unit 25 provides the automatically generated content to the user terminal 13 in real time.

[0100] Application Example 6 The artificial intelligence unit 28 of the management computer 11 automatically generates a destination, possible travel routes, travel distance, travel time, and number of points suited to each user 21 from various information acquired from the user terminal 13 and information stored in the auxiliary memory 16. The provided information processing unit 25 provides the automatically generated information to the user terminal 13.

[0101] Application Example 7 The application executed by the management computer 11 has data analysis and personalization functions. The artificial intelligence unit 28 of the management computer 11 analyzes the behavioral data of the user 21 acquired from the user terminal 13. The artificial intelligence unit 28 of the management computer 11 further automatically generates information to be provided including an experience customized to the needs and interests of the individual user 21. The information to be provided automatically generated by the artificial intelligence unit 28 is used for sales to companies and research institutes that use the user terminal 13B.

[0102] Application example 8 The application executed on the user terminal 13 provides a map and a community that connects the entire globe. Wherever a user 21A is on the globe, he or she can connect and interact with other users 21B through this application. In addition, the provided information processing unit 25 of the management computer 11 provides the user terminal 13 with information on community activities and events in each region, together with real-time map information.

[0103] Application Example 9 The application executed on the management computer 11 realizes an environment in which virtual reality experiences, augmented reality experiences, and photos can be shared among all user terminals 13. Users 21 can explore places around the world through virtual reality experiences and augmented reality experiences, and take and share photos. In addition, the photo sharing function of the application incorporates a function in which an artificial intelligence unit 28 automatically processes images to bring out their beauty.

[0104] Application Example 10 The application executed on the management computer 11 realizes a function that allows step points to be used as rewards for cashless payment services and as virtual currency. The reward processing unit 29 provides virtual currency and points to the user terminal 13 according to the distance actually walked by the user 21 and the environmentally friendly behavior of the user 21. This encourages the user 21 to have a healthy lifestyle and sustainable behavior.

[0105] Application Example 11 The artificial intelligence unit 28 has an assist function. The artificial intelligence unit 28 automatically generates a story, and automatically generates an interactive adventure game or experiential virtual reality content based on the story.

[0106] Application Example 12 The artificial intelligence unit 28 of the management computer 11 has a function of selling the automatically generated content for a fee, thereby enabling the administrator 20 of the management computer 11 to earn profits.

[0107] [Functions utilizing scan matching between 3D point cloud maps and vector maps] -Real-time 3D navigation Augmented reality city guides Virtual renovation of buildings Disaster simulation and rescue assistance -Virtual space travel experience These features provide a new experience by combining point cloud maps and vector maps.

[0108] [Notification function] -Haptic feedback - Audio guidance and voice control - Audio description of point cloud data Use of AI assistant - Voice recognition for inputting information This will create an environment where even blind people and elderly people can use the app safely and effectively.

[0109] [AI camera angle adjustment function] AI-based scene analysis · Use of point cloud maps and vector maps -Automatic angle adjustment - Tailored to meet user needs Real-time feedback Not only can camera systems with AI capabilities help photographers capture a scene more effectively, but they can also streamline the process by pinpointing locations on the earth using a point cloud map with associated latitude, longitude and coordinates, improving the quality of the footage captured.

[0110] [Business Model] Procuring and purchasing point cloud data. In this case, laser scanners are lent out for a fee or free of charge, and smartphones are lent out for a fee or free of charge, to procure point cloud data.

[0111] We lend out laser scanners to various people and modes of transportation (cars, bicycles, walking, etc.) to collect and update data. Riders (users) rent laser scanners, collect data in specific areas and locations, and earn revenue from the data they provide to our company. We offer a data purchase fee to users who procure the data. We set an appropriate purchase price depending on the quantity and quality of the data.

[0112] Data processing and analysis ·Map feature development Virtual tourism experience Education and Learning Apps For select clients, such as businesses and local governments, the company earns additional revenue by providing custom data solutions and consulting services.

[0113] [Functions and Features] ·Maps and communities that connect the dots The app allows users to connect and interact with others no matter where they are on the planet, and provides real-time map information along with local community activities and events.

[0114] ·VR / AR experiences and photo sharing Users can explore places around the world through virtual reality (VR) and augmented reality (AR), take and share photos, and the photo sharing function will incorporate AI to automatically enhance images and bring out their beauty.

[0115] - Health and brain training features The app helps users manage their health, offering daily exercise and food tracking features, as well as brain training games and relaxing audio-guided meditations.

[0116] Real-time Environmental Monitoring The app collects real-time environmental data from around the world and provides it to users. By providing important environmental information, such as air pollution, earthquake predictions, and climate change information, users are encouraged to take action to live more sustainable lives.

[0117] · Cashless payment service rebate and virtual currency for step points The system will allow users to earn cryptocurrency and points based on the distance they walk and the environmentally friendly actions they take, encouraging healthy lifestyles and sustainable behavior.

[0118] AI Assistant It learns the user's preferences and interests and suggests individually customized exploration routes and content. It is an AI assistant that listens to the user's voice and uses voice recognition technology to realize natural dialogue. When the user encounters unknown places or creatures, the AI ​​automatically provides information to ensure safety.

[0119] AI Chatbots An AI chatbot with emotion recognition capabilities that analyzes the user's emotions and psychological state and provides appropriate assistance and advice. A function that automatically forms groups based on common interests and hobbies to promote communication between users.

[0120] AI content generation A virtual world or space story that is automatically generated by AI based on the user's preferences and interests. A function that allows AI to create more attractive content by analyzing user behavior and feedback and provide it in real time.

[0121] · Undersea exploration and sharing Users can explore the ocean floor via robots and submersibles to uncover its mysteries, and can share their explorations with others through live streaming and photo and video sharing features.

[0122] Marine conservation and volunteering The app focuses on protecting the marine environment, educating users on the importance of marine ecosystems and biodiversity, and offering them the opportunity to take part in volunteer activities such as ocean cleanups and coral reef protection.

[0123] Continental exploration and earth studies Users can explore unknown places on Earth and learn about their culture and history, as well as receive educational content about the history of continental drift and how the Earth was formed.

[0124] Space exploration and astronomy The app will aid in the exploration of space through spacecraft and satellites, giving users the opportunity to explore the mysteries of the universe, and also provide information on astronomy and astrophysics.

[0125] Access to air travel and the aviation industry Not only do users enjoy the experience of flying, but they can also receive special experiences and discounts through partnerships with airlines and aircraft manufacturers.

[0126] Space Consulting and Future Prediction The app will work with space experts and futurists to provide space exploration consulting and future predictions, allowing users to explore future prospects and the possibilities of space development.

[0127] [Content composition] -AI walking course suggestions Based on various information, we suggest courses, routes, distances, times, and number of points that suit each individual.

[0128] AI Music The company offers emotional and immersive content, including music, soundscapes, and visual art generated by AI.

[0129] AI Assist We propose interactive adventure games and experiential VR content based on stories automatically generated by AI.

[0130] AI Support & Management The company will propose AI-driven content that offers meditation and relaxation modes to support and manage users' physical and mental health.

[0131] Exploration Series Explore the Earth's oceans: Users can explore the ocean floor and observe coral reefs and underwater creatures.

[0132] Into the unknown: Users board a spaceship and travel deep into the solar system and galaxy.

[0133] Time travel adventure Users can time travel to the past or future and explore history.

[0134] Universal Community Earth Community: Users on Earth interact and share Earth culture and events. Space Community: Alien lifeforms and space travelers interact and share space culture and technology.

[0135] Relaxation and meditation Natural sounds of the Earth: Users can relax while listening to natural sounds such as the ocean, forest, and mountains.

[0136] Cosmic sounds of space: Users meditate while feeling the silence of space and the brilliance of the stars.

[0137] Future Outlook Earth's future predictions: Experts provide predictions for the Earth's future and simulations of environmental changes. Space exploration predictions: Cosmologists predict the future of the universe and propose new possibilities for space exploration.

[0138] Virtual reality experience Virtual tour of the Earth: Users can experience famous tourist spots and cultural heritage sites in VR. Virtual travel in space: Users can experience outer space and unknown planets in VR.

[0139] -Edutainment content Earth Learning Quiz: Users can take quizzes about the geography, history and culture of the Earth. Space Science Games: Users can have fun while learning through games about the physics and astronomy of the universe.

[0140] [Business Plan] Data analysis and personalization The app analyzes users' behavioral data to provide a customized experience tailored to their individual needs and interests, and this data can also be sold to companies and research institutions.

[0141] Partnerships and Advertising The app will develop partnerships with health companies and environmental organizations to promote their products and services. It will earn revenue through advertising and sponsorship deals with airlines, shipping companies, environmental organizations, space companies, and others. It will also recruit companies to sponsor specific expeditions and events. It is expected to earn advertising revenue from environmentally conscious brands and companies. It will enter the education market by providing educational programs through partnerships with schools and universities. It will earn revenue through licensing fees from educational institutions and sales of educational materials.

[0142] - Use of virtual currency and point systems The virtual currency and points earned within the app can be used for discounts and rewards in partnerships, motivating users to actively use the app, connect with the community, and contribute to improving their health.

[0143] Ecotourism and sustainable travel The app promotes ecotourism through exploration of oceans, continents and space, and booking trips and experiences to selected locations includes a donation to support local environmental conservation and sustainable development.

[0144] Virtual reality experience sales They generate revenue by providing virtual experiences using VR and AR and selling those experiences, such as virtual tours of undersea exploration and space walks.

[0145] AI assistant subscription model Charging a monthly or annual subscription fee to access the features and services of the AI ​​assistant.

[0146] · Selling AI-generated content AI-generated content will be sold for a fee and revenue will be generated.

[0147] -AI-based user analysis and targeted advertising AI analyzes user behavior patterns and preferences and generates advertising revenue by providing targeted advertisements to advertisers.

[0148] Space Tour Operations Partner with space tour operators to arrange space travel and space immigration, and earn revenue from arrangement fees and commission.

[0149] ·Interdimensional communication services It provides communication services between other dimensions and universes and earns revenue from communication fees and service charges.

[0150] Historical exploration and ancient civilization tours Offer historical exploration and ancient civilization tours, allowing users to experience past worlds and cultures, and earn revenue from tour fees and sales of related merchandise.

[0151] Future prediction service The company provides a future prediction service for a fee, offering users a glimpse into future prospects and possibilities. It earns revenue from consulting fees and sales of prediction results.

[0152] The management computer 11 may have a cross reality function that combines virtual reality and augmented reality. In addition, a function that uses ultrasound to give the sensation of touching an object in front of the user may be added. In addition to the artificial intelligence function, the management computer 11 may have a general artificial intelligence (AGI) function and an artificial super intelligence (ASI) function. The management computer 11 may have an escort matching function when the user 21 goes out.

[0153] When the user 21 goes shopping, a shopping support function may be provided.

[0154] · It may have functions to support smartphone lectures, launching applications, recording information, and organizing documents.

[0155] - May have real-time monitoring capabilities by sharing maps and other information with family and friends.

[0156] The user terminal 13 may have a smart watch function.

[0157] When the user 21 does not go out for some reason, or wants to go out but is too lazy, the device may have a function for making the user 21 accustomed to light exercise until the user 21 goes out.

[0158] A simple home training function may be provided. For example, a function for giving points (converted into the number of steps) for indoor training may be provided.

[0159] The function of an artificial intelligence trainer may be included. The artificial intelligence may be a trainer and may have a function of displaying the form and pose of the user 21 in a human-shaped grid (in-camera and out-camera).

[0160] Artificial intelligence may include camera autofocus capabilities.

[0161] The device may have a function for providing a facial training (facial muscle training) menu.

[0162] The device may have a function for training the hands and feet of the user 21. For example, the user can use the in-camera to move his / her hands and feet in accordance with the pose form grid or image of the AI ​​trainer's face, hands, and body. The device may also have a function for the user 21 to challenge training missions and receive points or rewards when he / she achieves goals or tasks.

[0163] The application may have a function that allows the user 21 to take quizzes to increase points and compete in rankings. The application may also have a function that allows the user 21 to receive special bonuses and rewards by participating in periodic point increase challenges. Furthermore, the application may have a function that allows the user 21 to join many communities, go out and increase points through the application, and participate in community activities.

[0164] This allows the user 21 to easily earn the same points as if they were out and about, even if they are unable to go out for some reason, even while in bed. Also, by making training at home a habit, the user 21 can prevent dementia and make it a daily habit.

[0165] (Effects of the embodiment) By using the application on the user terminal 13, the user 21, for example, a user 21 aged 60 or older, is motivated to go outside and walk. In addition, by walking, the user 21 can contribute to eliminating lack of exercise and to promoting good health.

[0166] Furthermore, as shown in Fig. 7, when the management computer 11 determines that the start position and the destination have been selected in the user terminal 13, it permits the user terminal 13 to perform a combining process of combining a plurality of images including images related to the movement path from the start position to the destination, from the time the user 21 starts moving from the start position to the time the user reaches the destination. In contrast, when the management computer 11 determines that the start position and the destination have not been selected in the user terminal 13, it prohibits the combining process from being performed in the user terminal 13. The combining process includes the first to fourth functions described in Fig. 7. Therefore, the user 21 can use the realization of the first to fourth functions in the user terminal 13 as motivation for walking.

[0167] 7, the management computer 11 judges whether the user 21 has exercised before starting to move from the start position. Then, when the management computer 11 judges that the user 21 has exercised and that the start position and the destination have been selected, it permits the execution of the combining process in the user terminal 13. In contrast, when the management computer 11 judges that the user 21 has not exercised or that the start position and the destination have not been selected, it prohibits the execution of the combining process in the user terminal 13. Therefore, the user 21 can be motivated to exercise in advance before starting to move from the start position in order to realize the first to fourth functions in the user terminal 13.

[0168] 7, when the management computer 11 determines that the start position and the destination have been selected at the user terminal 13, the management computer 11 performs a process of generating one or more images to be used for performing the combining process at the user terminal 13. In contrast, when the management computer 11 determines that the start position and the destination have not been selected at the user terminal 13, the management computer 11 does not generate one or more images to be used for performing the combining process at the user terminal 13. This can further increase the motivation of the user 21 to realize the first to fourth functions at the user terminal 13.

[0169] Furthermore, the management computer 11 can connect the user terminal 13A used by the user 21A to the user terminal 13B used by another user 21A. Therefore, the user 21A and the user 21B can communicate with each other by talking to each other and sharing information with each other. This can eliminate the sense of loneliness of each user 21. Furthermore, the user 21 can train his / her brain by answering the quiz, and can exercise his / her ears by listening to the guide voice. This can suppress the decline of cognitive function.

[0170] Furthermore, when the judgment unit 27 of the management computer 11 judges in step S24 that the user 21 has reached the destination, the reward processing unit 29 of the management computer 11 executes processing to grant a reward according to the number of steps (distance, etc.) actually walked by the user 21. The reward processing unit 29 adds up the reward, stores it in the auxiliary memory 16, and sends it to the user terminal 13.

[0171] Furthermore, the display unit 34 of the user terminal 13 can display a map and candidate travel routes, and the display unit 34 may display information on the sea, the seabed, etc. Furthermore, the artificial intelligence unit 28 of the management computer 11 can machine-learn history information such as destinations and travel routes visited by the user 21 in the past, and "new images". The artificial intelligence unit 28 of the management computer 11 may automatically generate information that the user 21 would enjoy, such as destinations related to the hobby of the user 21, candidate travel routes with facilities related to the hobby, audio guides of celebrities the user 21 likes, explanations in text format, and methods for taking "new images".

[0172] Furthermore, the artificial intelligence unit 28 of the management computer 11 can machine-learn information (destinations, travel routes, “new images”, etc.) of multiple users 21 with similar preferences. The management computer 11 may then provide multiple user terminals 13 with the same content that is likely to please the users 21, such as destinations that match the hobbies, potential travel routes with facilities that match the hobbies, audio guides, text-format explanations, how to take “new images”, etc.

[0173] Furthermore, the application provided by the management computer 11 has a function to allow information (destination, travel route, "new images", etc.) of a user 21A with similar preferences to be acquired by the user terminal 13B of another user 21B, that is, a function to share information. Furthermore, the management computer 11 may disseminate various information and data acquired from the user terminal 13 by linking with a social networking service on the network 12.

[0174] Furthermore, in step S24 of FIG. 2, the reference information for judging whether or not the user 21 has reached the destination is stored in the auxiliary memory 16. Furthermore, the management computer 11 can judge that "the user 21 has reached the destination" when, for example, any one or more of the conditions included in the reference information are satisfied. Here, the artificial intelligence unit 28 of the management computer 11 may have a function of setting two or more conditions for judging that "the user 21 has reached the destination". Then, the accuracy of the management computer 11 in judging whether or not the user 21 has reached the destination is improved, and the quality of the information and data stored in the auxiliary memory 16 is improved.

[0175] In addition, the management computer 11 can quickly and accurately search for information and data regarding the movements of a user 21 who has reached his / her destination from among the various information and data stored in the auxiliary memory 16 of the management computer 11, and provide the information and data to the user terminal 13.

[0176] Furthermore, the artificial intelligence unit 28 of the management computer 11 can not only process the "new image" taken by the user terminal 13 with high accuracy, but also process the "new image" by associating it with the latitude, longitude, and three-dimensional coordinates of the location where the "new image" was taken. The artificial intelligence unit 28 of the management computer 11 can use the point cloud map stored in the auxiliary memory 16 to accurately display on the map the location on the earth where the "new image" was created, making the process more efficient and improving the quality of the taken "new image."

[0177] (supplementary explanation) The management computer 11 includes a single computer and a distributed computer configured of multiple devices. The management computer 11 may be any of a server, a supercomputer, a mainframe, a workstation, and the like.

[0178] An example of the technical meaning of the matters described in this embodiment is as follows. The information processing system 10 is an example of an information processing system. The management computer 11 is an example of an information processing device. The processor 14 is an example of a processor. The user terminals 13, 13A, and 13B are examples of user terminals. The user terminal 13B is an example of a service provider terminal.

[0179] Step S32 shown in FIG. 7 is an example of a first process, step S33 is an example of a second process, step S37 is an example of a third process, step S31 is an example of a fourth process, step S35 is an example of a fifth process, and step S36 is an example of a sixth process.

[0180] Step S23 shown in FIG. 2 is an example of the seventh process, step S24 is an example of the eighth process, step S23 and step S24 are examples of the ninth process, step S25 is an example of the tenth process, step S21 is an example of the eleventh process, step S23 is an example of the twelfth process and the thirteenth process, step S22 is an example of the fourteenth process, step S23 is an example of the fifteenth process, and step S23 and step S24 are examples of the sixteenth process and the seventeenth process.

[0181] The present embodiment also discloses the following features. For example, the present embodiment discloses a non-transient storage medium that stores an application that can be read by a computer that is communicably connected to a user terminal owned by a user via a network, and that causes the computer to execute the following processes: acquiring, from the user terminal, a start position where the user is located and a destination away from the start position; acquiring, from the user terminal, an image taken after the user starts moving from the start position; determining whether the user has reached the destination based on the image acquired from the user terminal; acquiring, from the user terminal, activity information of the user from the start position to the destination; and setting a reward to be given to the user terminal based on the activity information when it is determined that the user has reached the destination.

[0182] Further, there is provided an information processing method executed by a computer having a processor that executes processing and that is communicatively connected via a network to a user terminal carried by a user, in which the processor executes the following processes: a process of acquiring from the user terminal a starting position where the user is located and a destination away from the starting position; a process of acquiring from the user terminal an image taken after the user starts moving from the starting position; a process of determining whether the user has reached the destination based on the image acquired from the user terminal; a process of acquiring from the user terminal activity information of the user from the starting position to the destination; and a process of setting a reward to be granted to the user terminal based on the activity information when it is determined that the user has reached the destination.

[0183] Furthermore, this embodiment exemplifies an application (program) product including an application (program) that realizes various processes when the application (program) is executed by a processor. The processing unit described in this embodiment can also be defined as a processing circuit, a processor, or a processing means. The management unit can also be defined as a management circuit, a manager, or a management means. The judgment unit can also be defined as a judgment circuit, a judge, or a judgment means. The detection unit can also be defined as a detection circuit, a detector, or a detection means. [Industrial Applicability]

[0184] This embodiment can be used as an information processing device, an information processing system, and an application that combine and use a plurality of images. [Explanation of symbols]

[0185] 10...information processing system, 11...management computer, 13, 13A, 13B...user terminal, 14...processor

Claims

1. An information processing device having a processor for executing a process and communicably connected to a user terminal via a network, The processor, a first process for determining whether or not a start position from which the user carrying the user terminal actually starts moving has been selected on the user terminal and whether or not a destination away from the start position has been selected, before the user carrying the user terminal actually moves on the earth, by processing information acquired from the user terminal; a second process for permitting a combining process to be performed on the user terminal when it is determined that the starting position and the destination have been selected, the combining process being performed on the user terminal to combine a plurality of images including images related to a moving route from the starting position to the destination, from the time the user actually starts moving from the starting position to the time the user reaches the destination; a third process of prohibiting the user terminal from performing the combining process when it is determined that the selection of the start position and the selection of the destination have not been performed in the user terminal; a fourth process of determining whether the user has exercised before the user actually starts moving from the start position by processing information acquired from the user terminal; Run the second process executed by the processor further includes a process of permitting the user terminal to perform the coupling process when it is determined that the user has exercised before actually starting to move from the start position, and that the start position and the destination have been selected on a date on which the user exercised; The information processing device is configured such that the third process executed by the processor further includes a process of prohibiting the combination process from being performed on the user terminal when one or more of the following determinations are made: a determination that the user did not exercise, or a determination that the start position and the destination were not selected on the day the user exercised.

2. 2. The information processing device according to claim 1, The processor, a fifth process of generating one or more images to be used for performing a combining process on the user terminal when it is determined that the selection of the starting position and the selection of the destination have been performed on the user terminal on the date on which the user exercised; a sixth process of not generating one or more images to be used for performing a combining process on the user terminal when it is determined that the selection of the starting position and the selection of the destination have not been performed on the user terminal on the date when the user exercised; The information processing device is configured to further execute the above.

3. 2. The information processing device according to claim 1, The processor, A seventh process of acquiring, from the user terminal, an image captured after the user actually starts moving from the start position; an eighth process of determining whether or not the user actually reached the destination on the date on which the user exercised based on an image acquired from the user terminal; A ninth process of acquiring, from the user terminal, activity information of the user from the start position to the destination; a tenth process of setting a reward to be given to the user terminal based on the activity information when it is determined that the user actually reaches the destination on the date on which the user exercises; The information processing device is configured to further execute the above.

4. 4. The information processing device according to claim 3, The activity information acquired by the processor from the user terminal in the ninth process is an actual number of steps of the user after the user actually starts moving from the starting position; an actual distance traveled by the user after the user actually starts moving from the starting position; Whether or not the user has answered a quiz question after actually starting to move from the starting position; The accuracy rate of the answers to the quiz; An information processing device having a configuration including one or more pieces of information.

5. 2. The information processing device according to claim 1, The processor, an eleventh process of acquiring user information including a hobby of the user from the user terminal before the user actually starts moving from the start position; a twelfth process of providing the user terminal with at least one piece of information on a destination having a facility related to the user's hobby or a travel route having a facility related to the user's hobby, which are acquired from the user terminal before the user actually starts moving from the start position; The information processing device is configured to further execute the above.

6. 2. An information processing system comprising: the information processing device according to claim 1; and goggles communicably connected to the user terminal and worn on the body of the user, The processor, A fifteenth process of sending information on a moving route from the start position to the destination to the user terminal as virtual reality information recognizable by the user wearing the goggles; The information processing system is further configured to execute the above.

7. An application that causes a computer connected to a user terminal carried by a user via a network to execute a process, The computer includes: a first process for determining whether or not a start position from which the user carrying the user terminal actually starts moving has been selected on the user terminal and whether or not a destination away from the start position has been selected, before the user carrying the user terminal actually moves on the earth, by processing information acquired from the user terminal; a second process for permitting a combining process to be performed on the user terminal when it is determined that the starting position and the destination have been selected, the combining process being performed on the user terminal to combine a plurality of images including images related to a moving route from the starting position to the destination, from the time the user actually starts moving from the starting position to the time the user reaches the destination; a third process of prohibiting the user terminal from performing the combining process when it is determined that the selection of the start position and the selection of the destination have not been performed in the user terminal; a fourth process of determining whether the user has exercised before the user actually starts moving from the start position by processing information acquired from the user terminal; Run the command, The second process executed by the computer further includes a process of permitting the user terminal to perform the combining process when it is determined that the user has exercised and that the start position and the destination have been selected on the date that the user exercised; The application further includes a configuration in which the third process executed by the computer prohibits the combination process from being performed on the user terminal when one or more of the following determinations are made: a determination that the user did not exercise, or a determination that the starting position and the destination were not selected on the day the user exercised.

Citation Information

Patent Citations

  • Device and method for comparing mark image and program storage medium

    JP1999271074A

  • Game system

    JP2002233663A

  • Walking support system

    JP2007275281A

  • Prediction system

    JP2010244297A

  • Head-mounted display

    JP2013137413A

Cited By

  • Apparatus and method

    JP2026146487A