Information processing systems, information processing methods, and programs

Abstract

To provide more beneficial technology. [Solution] According to one aspect of the present invention, an information processing system is provided, comprising at least one processor, the processor being configured to perform the following steps by reading a program, the receiving step receiving input information from a user, and the display control step superimposing an object onto a specific space, the specific space being a real space or a virtual space, the object corresponding to a first object generated based on the input information, and the first object being displayed in response to an operation instruction for the object.

Description

Technical Field

[0001] The present invention relates to an information processing system, an information processing method, and a program.

Background Art

[0002] Patent Document 1 describes a handwritten information sharing system including a pen, a terminal communicably connected to the pen, and a server communicably connected to the terminal. The pen includes means for acquiring handwritten information written on paper and transmitting the handwritten information to the terminal. The terminal includes means for receiving the handwritten information transmitted from the pen and means for transmitting the received handwritten information to the server. The server includes means for receiving the handwritten information transmitted from the terminal, means for converting the received handwritten information into web data, and means for distributing the web data to a terminal connected via a network.

Prior Art Document

Patent Document

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] There is a need for a more useful information processing system and the like regarding information sharing.

[0005] In view of the above circumstances, the present invention aims to provide a more useful information processing system and the like regarding information sharing.

Means for Solving the Problems

[0006] According to one aspect of the present invention, an information processing system is provided, comprising at least one processor, the processor configured to perform the following steps by reading a program, the receiving step receiving input information from a user, and the display control step superimposing an object onto a specific space, the specific space being a real space or a virtual space, the object corresponding to a first object generated based on the input information, and the first object being displayed in response to an operation instruction for the object.

[0007] This configuration makes it possible to provide a more beneficial information processing system for information sharing. [Brief explanation of the drawing]

[0008] [Figure 1] This is a diagram showing the configuration of Information Processing System 1. [Figure 2] Block diagram showing the hardware configuration of Server 2. [Figure 3] This is a block diagram showing the hardware configuration of information processing device 3 and information processing device 4. [Figure 4] This block diagram shows the functions realized by Server 2 (Control Unit 23), Information Processing Device 3 (Control Unit 33), and Information Processing Device 4 (Control Unit 43). [Figure 5] This diagram shows an overview of the processes performed by Information Processing System 1. [Figure 6] This is an activity diagram showing an example of the processing flow performed by Information Processing System 1. [Figure 7] This diagram illustrates an example of a reception method for receiving input information D1 via screen G1. [Figure 8] This figure shows screen G2, which is an example of link information LA. [Figure 9] This figure shows screen G3A, which is an example of a screen displaying objects in a specific space. [Figure 10] This figure, G3B, is an example of a screen that displays objects in a specific space. [Figure 11] This figure shows screen G3C, which is an example of a screen displaying objects in a specific space. [Figure 12] This figure shows screen G4, which is another example of link information LA. [Modes for carrying out the invention]

[0009] Embodiments of the present invention will be described below with reference to the drawings. The various features shown in the embodiments below can be combined with each other.

[0010] Incidentally, the program for implementing the software appearing in one embodiment may be provided as a non-transitory computer-readable medium, or it may be provided as a downloadable medium from an external server, or it may be provided so that the program is launched on an external computer and its functions are realized on a client terminal (so-called cloud computing).

[0011] Furthermore, in various information processing according to one embodiment, an input and an output corresponding to the input can be realized. Here, as long as an output is obtained as a result of the input, the form of the information referenced in such information processing (hereinafter referred to as reference information) is not limited. The reference information may be, for example, rule-based information such as a database, a lookup table, or a predetermined function (including a decision formula such as a regression equation constructed by a statistical method), or a trained model that has been pre-trained to learn the correlation between input and output, or a generative AI such as a large-scale language model or visual language model that can output a desired result by inputting a prompt.

[0012] In addition, in one embodiment, the "unit" may include, for example, hardware resources implemented by a circuit in a broad sense and information processing of software that can be specifically realized by these hardware resources. Also, in one embodiment, various types of information are handled, and these information are represented, for example, by physical values of signal values representing voltage and current, the high and low of signal values as a set of binary bits composed of 0 or 1, or quantum superposition (so-called quantum bits), and communication and calculation can be executed on a circuit in a broad sense.

[0013] Furthermore, a circuit in a broad sense is a circuit realized by appropriately combining at least a circuit (Circuit), circuitry (Circuitry), a processor (Processor), and a memory (Memory), etc. Also, the processor may be a general-purpose processor or a dedicated circuit. That is, it includes an application specific integrated circuit (ASIC), programmable logic devices (for example, a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)), etc.

[0014] 1. Hardware Configuration In this section, the hardware configuration will be described.

[0015] <Information Processing System 1> The information processing system 1 is a system that enables users to communicate with each other. For example, the reception unit 231 receives input information D1 from the first user Y1. The generation unit 233 generates the first object Ob1 based on the input information D1. The first user Y1 sends link information LA for displaying the first object Ob1 to the second user Y2. When the second user Y2 gives an operation instruction for the link information LA, the second object Ob2 can be superimposed and displayed in a specific space. When the second user Y2 gives an operation instruction for the second object Ob2, the first object Ob1 can be superimposed and displayed in the specific space.

[0016] FIG. 1 is a configuration diagram showing the information processing system 1. The information processing system 1 includes a server 2, an information processing device 3, and an information processing device 4. The server 2, the information processing device 3, and the information processing device 4 are configured to be communicable through a telecommunication line (network). In an exemplary embodiment, the information processing device 3 and the information processing device 4 can function as client terminals for the server 2. Here, the system exemplified in the information processing system 1 is composed of one or more devices or components. Therefore, it should be noted that even the server 2 alone, or any one of the server 2, the information processing device 3, and the information processing device 4, may be included in the information processing system 1. More specifically, the information processing system 1 may include an element selected from the group consisting of the server 2, the information processing device 3, and the information processing device 4. Even if an unselected element is not included in the information processing system 1, it may be electrically connected to the selected element as an external element. These components will be described below.

[0017] <Server 2> FIG. 2 is a block diagram showing the hardware configuration of the server 2. The server 2 includes a communication unit 21, a storage unit 22, and a control unit 23, and these components are electrically connected via a communication bus 20 inside the server 2. Each component will be further described.

[0018] The communication unit 21 is comprised of a communication module. The communication module may be a wireless communication module compliant with standards such as IEEE 802.11a / b / g / n / ac / ax, LTE, 5G, 6G, or a wired communication module compliant with standards such as IEEE 802.3. The communication unit 21 is configured to transmit various electrical signals from the server 2 to external components. The communication unit 21 is also configured to receive various electrical signals from external components to the server 2. More preferably, the communication unit 21 may have a network communication function, thereby enabling the communication of various information between the server 2 and external devices via a network.

[0019] The memory unit 22 stores various types of information as defined above. This can be done, for example, as a storage device such as a solid-state drive (SSD) that stores various programs related to the server 2 executed by the control unit 23, or as memory such as random access memory (RAM) that stores temporarily necessary information (arguments, arrays, etc.) related to program calculations. The memory unit 22 stores various programs and variables related to the server 2 executed by the control unit 23.

[0020] The control unit 23 performs processing and control of the overall operation related to the server 2. The control unit 23 is, for example, a central processing unit (CPU) not shown. The control unit 23 realizes various functions related to the server 2 by reading predetermined programs stored in the memory unit 22. That is, information processing by software stored in the memory unit 22 is concretely realized by the control unit 23, which is an example of hardware, so that each step related to each function described later can be executed. These will be described in more detail in the next section. Note that the control unit 23 is not limited to being a single unit, and may be implemented with multiple control units 23 for each function, or a combination thereof.

[0021] <Information Processing Device 3> Information processing device 3 is an information processing device used by the first user Y1. Figure 3 is a block diagram showing the hardware configuration of information processing device 3 and information processing device 4. As shown in Figure 3A, information processing device 3 includes a communication unit 31, a storage unit 32, a control unit 33, a display unit 34, an input unit 35, and an imaging unit 36, and these components are electrically connected within the information processing device 3 via a communication bus 30. Each component will be described further. The descriptions of the communication unit 31, storage unit 32, and control unit 33 are the same as the descriptions of each part in server 2, so they will be omitted.

[0022] The display unit 34 may be included in the housing of the information processing device 3 or it may be an external component. The display unit 34 displays a graphical user interface (GUI) screen that can be operated by the first user Y1. This is preferably implemented by using different display devices such as a CRT display, liquid crystal display, organic EL display, and plasma display, depending on the type of information processing device 3.

[0023] The input unit 35 may be included in the housing of the information processing device 3 or it may be external. For example, the input unit 35 may be integrated with the display unit 34 and implemented as a touch panel. If it is a touch panel, the user can input tap operations, swipe operations, etc. Of course, a switch button, mouse, QWERTY keyboard, etc. may be used instead of a touch panel. In other words, the input unit 35 receives operation input made by the user. This input is transmitted as a command signal to the control unit 33 via the communication bus 30, and the control unit 33 can execute predetermined controls and calculations as needed.

[0024] The imaging unit 36 ​​may be included in the housing of the information processing device 3 or it may be external. For example, the imaging unit 36 ​​may include a camera module and use an optical sensor to acquire images and videos of the surroundings in real time. The imaging unit 36 ​​then transmits the acquired image data to the information processing device 3. The imaging unit 36 ​​may also have a function to recognize the user's position, movements, and environmental changes using, for example, visual recognition technology. The data acquired by the imaging unit 36 ​​is transferred to the control unit 33 via the communication bus 30, and the control unit 33 can perform predetermined controls and calculations as needed.

[0025] As the information processing device 3, smartphones, tablet devices, personal computers, wearable devices, etc., can be used.

[0026] <Information Processing Device 4> Information processing device 4 is an information processing device used by the second user Y2. As shown in Figure 3B, information processing device 4 comprises a communication unit 41, a storage unit 42, a control unit 43, a display unit 44, an input unit 45, and an imaging unit 46, and these components are electrically connected within the information processing device 4 via a communication bus 40. The descriptions of the communication unit 41, the storage unit 42, and the control unit 43 are the same as the descriptions of each part in server 2 and are therefore omitted. The descriptions of the display unit 44, the input unit 45, and the imaging unit 46 are the same as the descriptions of each part in information processing device 3 and are therefore omitted.

[0027] 2. Functional Configuration This section describes the functional configuration of this embodiment. Information processing by software stored in the memory unit 22 is specifically realized by the control unit 23, which is an example of hardware, and can be executed as each functional unit included in the control unit 23 (at least one processor provided by the information processing system 1).

[0028] Figure 4 is a block diagram showing the functions realized by Server 2 (control unit 23), Information Processing Device 3 (control unit 33), and Information Processing Device 4 (control unit 43).

[0029] Figure 4A is a block diagram showing the functions implemented by the control unit 23. The control unit 23 comprises a reception unit 231, a display control unit 232, a generation unit 233, a registration unit 234, a transmission unit 235, a layout unit 236, and a notification unit 237.

[0030] As shown in Figure 4B, the information processing device 3 (control unit 33) comprises a display unit 331 and an operation acquisition unit 332. As shown in Figure 4C, the information processing device 4 (control unit 43) comprises a display unit 431 and an operation acquisition unit 432.

[0031] The control unit 23 is configured as a receiving unit 231 to receive information from the information processing device 3 or the information processing device 4 or other devices. The control unit 23 is also configured to receive various information by reading various information stored in the storage area, which is at least a part of the memory unit 22, and writing the read information to the work area, which is at least a part of the memory unit 22. The storage area is, for example, the area of ​​the memory unit 22 that is implemented as a storage device such as an SSD. The work area is, for example, the area that is implemented as memory such as RAM.

[0032] The reception unit 231 can receive various information and instructions from each user.

[0033] The reception unit 231 can receive input information D1 from the user. Input information D1 includes handwritten characters and drawings. The reception unit 231 can receive handwritten characters and drawings depending on the interface used by the user. For example, when a user writes characters or draws a picture on the touch display of the information processing device 3 or information processing device 4 with a pen or finger, the reception unit 231 senses the writing in real time and receives the writing content as input information D1 using a pressure sensor. In this way, the reception unit 231 can receive the user's handwritten characters and drawings as input information D1. In addition, the reception unit 231 can receive written characters and drawings as input information D1 when the imaging unit 36 ​​or imaging unit 46 captures the user's writing movements in real time. Furthermore, when a user uses a writing pen, the reception unit 231 can receive handwritten input information D1 by tracking the movement and pressure of the pen. The reception unit 231 can sense the movement and shape of the hand in the air using a gesture recognition sensor and receive this as input information D1.

[0034] The reception unit 231 may accept handwritten characters or drawing paths (handwriting). The drawing paths can be obtained as line coordinate data.

[0035] The reception unit 231 can receive color or effect conditions for input information D1. Based on the received color or effect conditions, the generation unit 233 can generate a first object Ob1 from the input information D1. Effects may include line thickness and line type. As for line types, you can select lines that look like they were drawn with a chisel pen tip, lines that look like they were drawn with a crayon, neon-like lines, etc. As for effects, there may be effects that make the first object Ob1 appear to be emitting light, effects that emit small particles around the first object Ob1, or effects that make the first object Ob1 appear three-dimensional in space, move three-dimensionally, or rotate.

[0036] The reception unit 231 can receive user identification information. User identification information includes user identification information for user management and user identification information for display. User identification information for user management includes the user's name, email address, contact information, etc. The reception unit 231 receives the user's name, email address, etc. for user authentication. In addition, user identification information for display is used in the information processing system 1 as information to identify the user. User identification information for display includes the user's name, user signature, drawing representing the user, icon, and photograph, etc. User identification information for display may be displayed together with the second object Ob2.

[0037] The reception unit 231 can also receive a title for the input information D1. The title is displayed together with the first object Ob1, which is generated based on the input information D1, and the second object Ob2, which corresponds to the first object Ob1.

[0038] The display control unit 232 is configured to display various information on the information processing device 3 or the information processing device 4. The display control unit 232 controls the display of visual information such as screens, images including still images or moving images, icons, and messages (text) on the display unit 34 or the display unit 44. The display control unit 232 may also generate only rendering information for displaying visual information on the display unit 34 or the display unit 44 and transmit this to the information processing device 3 or the information processing device 4, thereby controlling the information processing device 3 or the information processing device 4 to generate visual information and display the visual information on the display unit 34 or the display unit 44. Alternatively, the display control unit 232 may generate visual information and transmit this to the information processing device 3 or the information processing device 4, thereby controlling the display of visual information on the display unit 34 or the display unit 44. The display control unit 232 executes processing to display system screens related to the information processing system 1 on each terminal. The display control unit 232 performs processes such as generating and sending HTML (Hyper Text Markup Language) files, and displays a web page showing the system screen on the display unit 34 or display unit 44. The display control unit 232 may also perform processes such as generating and sending display data for applications that use the information processing system 1. For example, the display control unit 232 can display various visual information on the display unit 34 or display unit 44.

[0039] The display control unit 232 displays a specific space, including an object, in response to an operation instruction for the link information LA. This specific space can be a real space or a virtual space. The real space is the physical space in which the user actually exists. The real space is the space surrounding the information processing device 3 or information processing device 4, which is captured by the imaging unit 36 ​​or imaging unit 46 using an optical sensor. On the other hand, a virtual space is a virtual environment created by a computer, in which the user can perform operations and move around. The virtual space may be a space that combines elements of the real space with digital elements using augmented reality (AR) or virtual reality (VR) technology.

[0040] The reception unit 231 may accept settings for a specific space from the user. For example, the reception unit 231 can accept settings and instructions on how to process images of the real space using augmented reality (AR) or virtual reality (VR) technology. The display control unit 232 can display the specific space according to the accepted settings. For example, the reception unit 231 may accept a specification of the display mode for the specific space. The reception unit 231 accepts a specification of the display mode in the specific space for each second object Ob2. The display mode specification may be, for example, retro mode, sunset mode, night view mode, etc. The display control unit 232 displays the specific space including the second object Ob2 or the first object Ob1 in the accepted display mode. The reception unit 231 may also accept a specification of virtual objects to be placed in the specific space. The display control unit 232 can display the specific space in which the accepted virtual objects are placed.

[0041] The display control unit 232 displays the generated object in a specific space. The display control unit 232 performs rendering processing to display the generated object in a specific space. The display control unit 232 displays the object in a specific space based on the object placement determined by the placement unit 236. The display control unit 232 changes the display state of the object in response to the user's movement and change of viewpoint. The display control unit 232 dynamically adjusts the size and transparency of the object in response to the user's change of viewpoint. The display control unit 232 updates the viewpoint and position information in real time as the user moves, and adjusts the position of the object to match the user's new viewpoint for display. For example, if the user points the camera upwards into the air, the display control unit 232 adjusts the angle and size of the object for easier viewing by the user.

[0042] The display control unit 232 causes an object in a specific space to be displayed on the display unit 34 or 44 of the information processing device 3 or information processing device 4. The display control unit 232 superimposes the object in the specific space. The display control unit 232 displays existing objects in the specific space. The display control unit 232 can display the first object Ob1 in a manner that reproduces the drawing path. The display control unit 232 displays the first object Ob1 with a color according to the received conditions or the first object Ob1 with an effect applied.

[0043] The object is generated based on input information D1 entered by each user. The object includes a first object Ob1 and a second object Ob2. The first object Ob1 is an object generated based on input information D1. The second object Ob2 is an object generated independently of input information D1 and is associated with each first object Ob1. The display control unit 232 displays the second object Ob2 in association with the user identification information.

[0044] When the display control unit 232 receives an operation instruction for the second object Ob2, it performs a suppression process on the second object Ob2, or performs the suppression process and then displays the first object Ob1. The suppression process is a process that suppresses the visibility of an object. The display control unit 232 may perform the suppression process on a specific space until the display of the first object Ob1 is complete.

[0045] The generation unit 233 is configured to generate various types of information. When the generation unit 233 receives a room generation instruction, it generates a room. Based on the input information D1, the generation unit 233 generates a first object Ob1. The generation unit 233 generates a second object Ob2 corresponding to the first object Ob1. The generation unit 233 can generate various types of links. The generation unit 233 generates link information LA for accessing an object based on the input information D1 of the first user Y1.

[0046] The generation unit 233 generates a plurality of first objects Ob1 based on the input information D1 transmitted from the reception unit 231. If the input information D1 includes a drawing path handwritten by the user, the first objects Ob1 are generated based on the drawing path. The generation unit 233 recognizes the user's drawing path as a line and generates the first objects Ob1. The generation unit 233 generates the first objects Ob1 as three-dimensional drawing objects. The generation unit 233 may generate the first objects Ob1 as three-dimensional objects with a specific depth (Z axis) and position (X, Y axes). The generation unit 233 may generate the first objects Ob1 including position information, size information, and display angle.

[0047] The registration unit 234 is configured to register various types of information. The registration unit 234 is configured to register information obtained from an external source or an internal system in a format appropriate to the system. The registration unit 234 receives information from the user and information obtained from an external database and stores it in the storage unit 22. Based on the user's instructions, the registration unit 234 registers at least one of the user's signature, drawing, icon, and photograph as user identification information.

[0048] The transmission unit 235 is configured to transmit generated information and data to a specified destination. The transmission unit 235 can transmit link information LA to a second user Y2.

[0049] The placement unit 236 is configured to be able to place objects. The placement unit 236 determines the coordinates in which to display an object in a specific space. That is, the placement unit 236 determines the coordinates (X, Y, Z) in which to display the object. The placement unit 236 may also dynamically determine the placement position by tracking the current spatial position and viewpoint of the user using the camera and sensors of a smartphone or AR device. Alternatively, the placement unit 236 may determine the placement of the object by considering the user's viewpoint and the depth of the specific space. Furthermore, the placement unit 236 fine-tunes the placement of the object in response to changes due to the user's movement or changes in the user's viewpoint.

[0050] When displaying multiple objects in a specific space, the placement unit 236 places the multiple objects generated by the generation unit 233 in the air. For example, the placement unit 236 can arrange multiple objects so that appropriate distances are maintained between them to ensure visibility.

[0051] The placement unit 236 may place multiple objects, taking into consideration not only the second object Ob2 that is displayed first, but also the first object Ob1. Furthermore, the placement unit 236 may place multiple objects, taking into consideration the colors, effects, and text lengths of multiple first objects Ob1 and multiple second objects Ob2. For example, the placement unit 236 may determine the placement of multiple objects by considering the balance of colors and effects. Additionally, if the reception unit 231 receives new input information D1 and objects are added, the placement unit 236 readjusts the placement of multiple objects.

[0052] Furthermore, the placement unit 236 may place multiple objects while taking into consideration the design of a specific space. For example, in a specific space with a design in which a virtual object is placed in the center, multiple objects may be placed while avoiding the virtual object. The placement unit 236 may also receive placement instructions from a first user Y1 and place multiple objects according to the instructions. Placement instructions from the first user Y1 may include, for example, instructions regarding the priority of users among multiple users, or instructions to change or adjust the placement of multiple objects that have already been placed.

[0053] The placement unit 236 can place the first object Ob1 and the second object Ob2 in a specific space at a remote location. Based on the remote location information specified by the user, the first object Ob1 and the second object Ob2 can be placed in an image of the specific space identified.

[0054] The notification unit 237 is configured to be able to report various types of information. When the notification icon is selected by the first user Y1, the notification unit 237 notifies the relevant personnel of the information processing system that the content of the object generated based on the input information D1 entered by the second user Y2 is inappropriate.

[0055] <Display> The display unit 331 of the information processing device 3 and the display unit 431 of the information processing device 4 each display the screen indicated by the screen data transmitted from the server 2.

[0056] <Operation acquisition section> The operation acquisition unit 332 of the information processing device 3 receives operations from a first user Y1 using the information processing device 3. The operation acquisition unit 432 of the information processing device 4 receives operations from a second user Y2 using the information processing device 4.

[0057] 3. Information Processing Flow This section describes the flow of the information processing method executed by the information processing system 1. As shown below, the information processing method comprises each step executed by the information processing system. The information processing program of this embodiment causes the computer to execute each step of the information processing system. The order of processing can be changed as appropriate, multiple processes may be executed simultaneously, and some processes may be omitted.

[0058] 3.1 Overview Figure 5 is a diagram illustrating the overview of the processing performed by the information processing system 1. In this processing, first, the reception unit 231 receives input information D1 from the user (step S001). Next, the display control unit 232 superimposes and displays a second object Ob2 in a specific space (step S002). The specific space is either real space or virtual space, and the second object Ob2 corresponds to the first object Ob1 generated based on the input information D1. Next, the display control unit 232 displays the first object Ob1 in response to operation instructions for the second object Ob2 (step S003).

[0059] 3.2 Specific Examples The following describes an example of the processing flow performed by the information processing system 1, using Figures 6 to 12. This example of the flow may be included within the scope defined in the overview described above. Note that the information processing may include any exception handling not shown. Exception handling includes interrupting the information processing or omitting each process. The selection or input performed in the information processing may be based on user operation or may be performed automatically without user operation.

[0060] <First Embodiment> Next, Figure 6 is an activity diagram showing an example of the processing flow performed by the information processing system 1. The following explanation will follow each activity in this activity diagram.

[0061] First, the reception unit 231 receives an instruction from the operation acquisition unit 332 to download a program to execute the information processing system 1 (Activity A101). The program to execute each step of the information processing system 1 is downloaded to the information processing device 3 via the network.

[0062] Next, the reception unit 231 receives user identification information for the first user Y1 (activity A102). Here, user identification information includes user identification information for user management and user identification information for display. User identification information for user management includes the user's name, email address, contact information, etc. The reception unit 231 receives the user's name, email address, etc. for user authentication. The user identification information for display is the user identification information that is displayed in association with the second object Ob2 in the information processing system 1. The user identification information for display may be a handwritten signature or drawing. The reception unit 231 can receive handwritten signatures or drawings in the same way as input information D1.

[0063] Next, the registration unit 234 registers at least one of the user's signature, drawing, icon, and photograph as user identification information based on the instructions of the first user Y1 (Activity A103). The registration unit 234 can register the handwritten signature or drawing of the first user Y1 received by the reception unit 231 as user identification information. By using a handwritten signature or a handwritten illustration representing the user as user identification information, the second user Y2 can feel the warmth of handwriting even from the user identification information.

[0064] Next, the reception unit 231 receives input information D1 from the first user Y1 (Activity A104).

[0065] Figure 7 illustrates an example of a reception method for receiving input information D1 via screen G1. The reception unit 231 can receive input information D1 when a first user Y1 writes characters on screen G1 of the information processing device 3 using a pen. The input information D1 includes handwritten characters or pictures by the first user Y1. The input information D1 may also include the drawing path of the handwritten characters or pictures by the first user Y1.

[0066] Next, the generation unit 233 generates a first object Ob1 based on the input information D1 (activity A105). The reception unit 231 receives the conditions for color and effect for the first object Ob1, and generates a first object Ob1 with the color or effect applied based on the received conditions. If the input information D1 includes the user's drawing path, the generation unit 233 generates the first object Ob1 based on the drawing path.

[0067] Next, the generation unit 233 generates a second object Ob2 corresponding to the first object Ob1 (activity A106). The second object Ob2 is preferably an object that allows the image of the specific space to be visible even when the second object Ob2 is superimposed on the specific space. The second object Ob2 is an object with high transparency that allows the specific space to be visible, such as a soap bubble or a transparent ball. The shape of the second object Ob2 is not particularly limited, but examples include a sphere, ellipsoid, polyhedron, balloon shape, teardrop shape, heart shape, etc. The shape of the second object Ob2 may be predetermined or determined by the selection of the first user Y1.

[0068] The generation unit 233 associates the registered first user Y1's display user identification information with the second object Ob2. The generation unit 233 generates the second object Ob2, which includes the first user Y1's display user identification information. The generation unit 233 adjusts the size and position of the user identification information so that it is displayed within the second object Ob2 when the display control unit 232 displays the second object Ob2. Furthermore, if the reception unit 231 receives instructions for color or effect for the user identification information, the generation unit 233 may apply the received color or effect to the user identification information before generating the second object Ob2, which includes the user identification information.

[0069] Next, the generation unit 233 generates link information LA corresponding to the first object Ob1 (activity A107). Link information LA is information for the second user Y2 to access the first object Ob1. Link information LA may include information about the link that can access the first object Ob1, the link's expiration date, the user's identification information that generated the link, access permissions, etc. Link information LA is generated in URL format, in-app deep link format, etc.

[0070] Next, based on instructions from the first user Y1, the transmission unit 235 transmits link information LA corresponding to input information D1 to a second user Y2, who is different from the first user Y1 (Activity A108). The transmission unit 235 can transmit link information LA to the second user Y2 via in-app notification, email notification, SMS notification, messaging app notification, etc. Subsequently, the second user Y2 receives the link information LA, and the display unit 431 displays the link information LA.

[0071] Figure 8 shows screen G2, which is an example of link information LA. Screen G2 includes areas G21 to G25. Area G21 is the area that displays the identification information (display name) of the first user Y1. In area G21, "Tommy" is displayed as the display name of the first user Y1. Area G23 is the area that displays information about the link information LA from the first user Y1 to the second user Y2. The information about the link information LA is, for example, the subject and message related to the first object Ob1 associated with the link information LA. Area G24 is the area that contains the link to display the first object Ob1. Area G25 is the area where the 2D code to display the first object Ob1 is displayed.

[0072] Next, the reception unit 231 receives an operation instruction for the link information LA (activity A109). For example, the reception unit 231 receives an operation instruction for the link information LA from a second user Y2. Specifically, when the reception unit 231 receives an operation instruction for area G24 from the second user Y2, the control unit 23 performs an authentication check for the second user Y2 and verifies the validity of the link. If authentication is successful, it grants access to the first object Ob1. Note that the operation instruction for the link information LA may also be performed by reading the two-dimensional code displayed in area G25 using the information processing device 4.

[0073] The control unit 43 activates the camera of the information processing device 4 and displays an image of the real space (an example of a specific space) captured by the camera on the display unit 431 (Activity A110).

[0074] Next, the display control unit 232 displays a screen in which the second object Ob2 is superimposed on a specific space (Activity A111). In other words, the display control unit 232 displays a specific space including the second object Ob2 in response to an operation instruction for the link information LA.

[0075] Figure 9 shows screen G3A, an example of a screen displaying an object in a specific space. Screen G3A includes regions G31 to G35 and the second object Ob2-1. Regions G31 to G36 and the second object Ob2-1 are displayed superimposed on an image of the real space. Region G31 is the region that accepts transitions to the previous screen. Region G32 is the region that accepts capture instructions. When the user gives an operation instruction to region G32, they can capture screen G3A, which displays the second object Ob2 in a specific space. Region G33 is the region that displays user identification information associated with the second object Ob2-1. Region G33 displays the handwritten signature of the first user Y1 as the identification information of the first user Y1. The handwritten signature of the first user Y1 is the user identification information of the first user Y1 registered in activity A103. The display control unit 232 can display the second object Ob2 in association with user identification information. Area G34 is the area for displaying the title of the second object Ob2-1. The display control unit 232 can display the second object Ob2 corresponding to input information D1 in association with its title. Area G35 is the area for accepting transitions to the message (input information D1) reception screen.

[0076] Next, the reception unit 231 receives an operation instruction for the second object Ob2 (Activity A112).

[0077] Next, the display control unit 232 performs a suppression process on the second object Ob2 (activity A113). When the reception unit 231 receives an operation instruction for area G33, the display control unit 232 can start the suppression process on the second object Ob2. Specifically, the display control unit 232 performs a suppression process on the second object Ob2-1 and displays the first object Ob1-1. The suppression process on the second object Ob2-1 is a process that makes the second object Ob2-1 difficult to see or a process that makes the second second object Ob2-1 invisible. When the display control unit 232 starts the suppression process on the second object, the second object Ob2-1 gradually becomes difficult to see. The display control unit 232 may, for example, make the second object Ob2-1 disappear, like a soap bubble bursting and disappearing.

[0078] Next, the display control unit 232 performs a suppression process on a specific space (activity A114) until the display of the first object Ob1 is complete. The suppression process on a specific space is a process that makes the specific space difficult to see or makes the specific space invisible. The display control unit 232 can perform the suppression process on the specific space, or perform the suppression process, and then display the first object Ob1. In this manner, the first object Ob1-1 can be made to stand out.

[0079] Next, the display control unit 232 displays the first object Ob1 in a manner that reproduces the drawing path (Activity A115). When displaying the first object Ob1-1, the display control unit 232 can display the object Ob1-1 according to the drawing path (handwriting). This manner makes it possible to give the user the feeling that the writing is being done by hand right in front of them.

[0080] Figure 10 shows screen G3B, an example of a screen displaying an object in a specific space. Screen G3B includes regions G31-G32, G34-G35, and the first object Ob1-1a. Regions G31-G32, G34-G35, and the first object Ob1-1a are displayed superimposed on an image of the real space. Here, the image of the real space has been subjected to suppression processing, reducing its visibility. The first object Ob1-1a is in the process of being displayed according to the handwriting. Regions G31-G32 and G34-G35 are the same as in screen G3A, so their explanation is omitted.

[0081] Next, the display control unit 232 displays a screen in which the first object Ob1 is superimposed on a specific space (activity A116). Once the display control unit 232 has finished displaying the first object Ob1, the display control unit 232 displays screen G3C.

[0082] Figure 11 shows screen G3C, an example of a screen displaying an object in a specific space. Screen G3C includes regions G31-G32, G34-G35, and the first object Ob1-1. Regions G31-G32, G34-G35, and the first object Ob1-1 are displayed superimposed on an image of the real space. Regions G31-G32 and G34-G35 are the same as in screen G3A, so their explanation is omitted.

[0083] In the above embodiment, in activity A109, screen G2 was displayed as an example of link information LA. However, if the second user Y2 is also a registered user of the information processing system 1, an in-app notification of the information processing system 1 may be made. Figure 12 shows screen G4, which is another example of link information LA. Screen G4 includes area G41, and area G41 includes areas G42 to G48. Area G41 is an area that displays information related to link information LA. Area G42 is an area that displays the display name of the first user Y1, who is the sender of the link information LA. Area G43 is an area that displays the subject of the link information LA. Area G44 is an area that displays the date and time the link information LA was sent. Area G45 is an area that accepts registration of the link information LA as a favorite. When the reception unit 231 receives an operation instruction for area G45, the registration unit 234 registers the first object Ob1 corresponding to the link information LA as the favorite information of the second user Y2. By saving it as a favorite, the second user Y2 can view the first object Ob1, which corresponds to the link information LA, even after it has been deleted from server 2. Area G46 displays whether the link information LA is still valid. Area G47 displays the number of participants in the room related to the link information LA. Area G48 displays the number of objects associated with the link information LA.

[0084] In the above embodiment, area G32 of screen G3A is an area that accepts a shooting instruction. Area G32 can accept not only imaging of screen G3A, but also recording a video from screen G3A through screen G3B to screen G3C. The reception unit 231 may, for example, accept a click operation on area G32 as an instruction to capture the screen at that moment, and a long press operation on area G32 as an instruction to start recording. In this manner, it is possible to record a video of the second object Ob2, which is superimposed on a specific space, becoming the first object Ob1. In this way, by having a shooting function, it is possible to save image data and video data of an object superimposed on a specific space at a special moment. The transmission unit 235 can also transmit the captured image data and video data to other users.

[0085] In the above embodiment, the display control unit 232 activated the camera of the information processing device 4 for the second user Y2 and displayed a specific space. However, the display control unit 232 may also receive location information for a specific space from the second user Y2 and display a specific space located in a remote location. The display control unit 232 receives location information for a specific space from the user. The display control unit 232 acquires an image of a place (tourist spot, facility, landscape, etc.) related to the location information received from the user. The placement unit 236 places an object in the remote specific space based on the acquired image. The display control unit 232 superimposes the object onto the specific space and displays it on the user's display unit 331. The display control unit 232 changes the display state of the object in response to the user's movement or change in viewpoint. The display control unit 232 dynamically adjusts the size and transparency of the object in response to the user's change in viewpoint. In this manner, an object can be superimposed onto a remote specific space.

[0086] In the above embodiment, the transmission unit 235 was described as sending link information LA to the second user Y2 to display the first object Ob1 generated based on the input information D1 of the first user Y1. However, it is also possible to receive input information D1 from the second user Y2, first generate a room to display the object based on the input information D1 of the second user Y2, and then invite the second user Y2 to the room. The second user Y2 can join the room by giving an operation instruction to the link information LA corresponding to the room. In other words, the reception unit 231 receives a generation instruction from the first user Y1 via the communication network to generate a room that two or more users can join. The generation unit 233 generates link information LA for joining the room. The transmission unit 235 transmits the link information LA to the second user Y2.

[0087] There may be multiple second users Y2, and in a room with multiple users, multiple input information D1 may be received, and multiple objects based on the multiple input information D1 may be superimposed in a specific space. The display control unit 232 and the arrangement unit 236 can adjust the arrangement and display of the multiple objects. In this way, within the room, participants can send messages to each other, and the participants of the room can jointly create a collaborative message by arranging multiple objects based on the multiple input information D1.

[0088] Furthermore, the control unit 23 may also include a notification unit 237. For example, the display control unit 232 displays a notification icon on the first user terminal used by the first user Y1. The display control unit 232 may also display the notification icon on the management screen of the first user Y1. When the notification icon is selected by the first user Y1, the notification unit 237 notifies the relevant parties of the information processing system that the content of an object generated based on input information D1 entered by the second user Y2, which is included in the room, is inappropriate. The relevant parties are at least one of the owners, administrators, and operators of the information processing system. In this manner, when inappropriate content is posted, the relevant parties of the system can be notified and taken action such as deleting the post.

[0089] 4. Effect The operation of this embodiment can be summarized as follows: In other words, this configuration allows for communication that combines the warmth of a handwritten letter with personal expression. Users can write and share text and illustrations by hand. When a second user Y2, who has received the link information LA, taps the second object Ob2, the handwritten message from the first user Y1 is displayed, tracing the handwriting. This configuration allows users to receive the message with a warm feeling, as if it were being handwritten right in front of them.

[0090] Although embodiments of the present invention have been described above, the present invention is not limited thereto and can be modified as appropriate without departing from the technical spirit of the invention.

[0091] 5. Others The overall configuration shown in Figure 1 is just one example and is not limited to it. For example, Server 2 may be distributed across two or more devices, or it may be replaced by a cloud computing system. Also, all processing may be performed on Server 2, or all processing may be performed on Information Processing Unit 3 or Information Processing Unit 4. An application may be installed on Information Processing Unit 3 or Information Processing Unit 4, and Information Processing Unit 3 or Information Processing Unit 4 and Server 2 may work together to execute the processing described above.

[0092] Server 2 may be on-premises or in a cloud environment. In the case of a cloud-based Server 2, for example, it may provide the above functions and processing in the form of SaaS (Software as a Service) or cloud computing.

[0093] In the above embodiment, Server 2 performed various storage and control functions, but instead of Server 2, multiple external devices may be used. That is, various information and programs may be distributed and stored across multiple external devices using blockchain technology or the like.

[0094] The embodiments of this model are not limited to the information processing system 1, but may also be an information processing method or a program. The information processing method comprises each step executed by the information processing system 1. The program causes a computer to execute each step of the information processing system 1.

[0095] The product may be provided in any of the following embodiments.

[0096] (1) An information processing system comprising at least one processor, wherein the processor is configured to perform the following steps by reading a program, the receiving step of receiving input information from a user, and the display control step of superimposing an object on a specific space, where the specific space is a real space or a virtual space, the object corresponds to a first object generated based on the input information, and the first object is displayed in response to an operation instruction for the object.

[0097] (2) An information processing system as described in (1) above, wherein the generation step further generates the first object based on the input information, wherein the input information includes the user's drawing path, and the first object is generated based on the drawing path.

[0098] (3) An information processing system as described in (2) above, wherein the display control step displays the first object in a manner that reproduces the drawing path.

[0099] (4) An information processing system according to any one of (1) to (3) above, wherein in the display control step, when the operation instruction for the object is received, a suppression process is performed on the object, or the first object is displayed after the suppression process is performed, wherein the suppression process is a process that suppresses the visibility of the object.

[0100] (5) An information processing system as described in (4) above, wherein in the display control step, the suppression process is performed on the specific space until the display of the first object is completed.

[0101] (6) An information processing system according to any one of (1) to (5) above, wherein the reception step further receives user identification information of the user, and the display control step displays the object in association with the user identification information.

[0102] (7) An information processing system as described in (6) above, wherein in the registration step, based on the user's instructions, the information processing system further registers at least one of the user's signature, drawing, icon, and photograph as the user identification information.

[0103] (8) An information processing system according to any one of (1) to (7) above, wherein the reception step further receives a title for the input information, and the display control step displays the object corresponding to the input information and the title in association.

[0104] (9) An information processing system according to any one of (1) to (8) above, wherein the reception step receives a condition for color or effect on the first object, and the display control step displays the first object of the color or the first object to which the effect is applied according to the received condition.

[0105] (10) An information processing system according to any one of (1) to (9) above, wherein in the reception step, the system receives a specification of a display mode in the specific space for each object, and in the display control step, the system displays the specific space including the object or the first object in the received display mode.

[0106] (11) An information processing system according to any one of (1) to (10) above, wherein in the receiving step, link information corresponding to the input information is received, and in the display control step, the specific space including the object or the first object is displayed in response to an operation instruction for the link information.

[0107] (12) An information processing method comprising each step performed by the information processing system described in any one of (1) to (11) above.

[0108] (13) A program that causes a computer to perform each step of the information processing system described in any one of (1) to (11) above. Of course, this is not always the case.

[0109] Finally, various embodiments of the present invention have been described, but these are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims and their equivalents. [Explanation of symbols]

[0110] 2: Server 20: Communications bus 21: Communications Department 22: Storage section 23: Control Unit 231: Reception Department 232: Display Control Unit 233 :Generation part 234: Registration Department 235: Transmitter 236: Placement section 3: Information Processing Device 30: Communications bus 31: Communications Department 32: Storage section 33: Control Unit 331: Display section 332: Operation acquisition section 34:Display section 35: Input section 36: Imaging Unit 4: Information Processing Device 40: Communications bus 41: Communications Department 42: Storage section 43: Control Unit 431: Display section 432 :Operation acquisition part 44: Display section 45: Input section 46: Imaging Department D1: Input Information Dn: Input Information G1: Screen G2: Screen G21 :Area G23 :Area G24 :Area G25 :Area G31 :Area G32 :Area G33 :Area G34 :Area G35 :Area G36 :Area G3A: Screen G3B: Screen G3C:Screen G4: Screen G41 :Area G42 :Area G43 :Area G44 :Area G45 :Area G46 :Area G47 :Area G48 :Area LA: Link Information Ob: Object Ob1: The first object Ob2: Second object RA: Room Y1: User Y2: User

Claims

1. An information processing system, Equipped with at least one processor, The aforementioned processor is configured to perform the following steps by reading a program: In the registration step, the system receives input information from the user. In the display control step, A second object is superimposed on a specific space, where the specific space is either real space or virtual space, and the second object corresponds to the first object generated based on the input information. An information processing system that displays the first object in response to an operation instruction for the second object.

2. In the information processing system described in claim 1, Furthermore, in the generation step, the information processing system generates the first object based on the input information, where the input information includes the user's drawing path, and the first object is generated based on the drawing path.

3. In the information processing system described in claim 2, The information processing system, in the display control step, displays the first object in a manner that reproduces the drawing path.

4. In the information processing system described in claim 1, In the display control step, upon receiving the operation instruction for the second object, the system performs a suppression process on the second object, or performs the suppression process and then displays the first object, wherein the suppression process is a process that suppresses the visibility of the second object.

5. In the information processing system described in claim 4, The information processing system, in the display control step, performs the suppression process on the specific space until the display of the first object is completed.

6. In the information processing system described in claim 1, In the aforementioned reception step, the user identification information of the user is further received. An information processing system that, in the display control step, displays the second object in association with the user identification information.

7. In the information processing system described in claim 6, Furthermore, in the registration step, the information processing system registers at least one of the user's signature, drawing, icon, and photograph as user identification information based on the user's instructions.

8. In the information processing system described in claim 1, In the aforementioned reception step, a title for the input information is also received. An information processing system that, in the display control step, displays the second object corresponding to the input information and the title in association.

9. In the information processing system described in claim 1, In the reception step, the conditions for color or effect for the first object are received. The information processing system, in the display control step, displays the first object of the color according to the received conditions, or the first object to which the effect has been applied.

10. In the information processing system described in claim 1, In the reception step, for each of the second objects, the specification of the display mode in the specific space is received. The information processing system, in the display control step, displays the specific space including the second object or the first object in the received display mode.

11. In the information processing system described in claim 1, Furthermore, in the transmission step, link information corresponding to the input information is transmitted. The information processing system, in the display control step, displays the specific space including the second object or the first object in response to an operation instruction for the link information.

12. Information processing method, An information processing method comprising each step performed by the information processing system according to any one of claims 1 to 11.

13. It is a program, A program that causes a computer to perform each step of the information processing system described in any one of claims 1 to 11.

Images