Content distribution system, content distribution method, and content distribution program

Abstract

Provided is a content distribution system that distributes content that presents a virtual space to a plurality of user terminals, the content distribution system including at least one processor. The at least one processor detects a specific situation in which a virtual avatar configured in the virtual space corresponding to a user 1 performs a specific action prescribed in advance, and the specific action is hidden from a user 2 who is different from the user 1. If the specific situation is detected, an image of the content that presents the virtual space is displayed on a user terminal of the user 2 in such a manner that the specific action cannot be visually recognized.

Description

Technical Field

[0001] One aspect of this invention relates to a content publishing system, a content publishing method, and a content publishing procedure. Background Technology

[0002] A switching mechanism is known to switch between whether to share a virtual space (virtual reality space) with other users based on user needs. For example, Patent Document 1 discloses an information processing device that allows users to alternate between a shared mode (sharing the virtual space with other users) and a non-shared mode (not sharing the virtual space with other users) by clicking a switch button.

[0003] Existing technical documents

[0004] Patent documents

[0005] Patent Document 1: Japanese Patent Application Publication No. 10-105541 Summary of the Invention

[0006] Inventions are dedicated to solving problems

[0007] In the mechanism disclosed in Patent Document 1, whether or not the virtual space is shared with other users depends on the mode selected by the user. Therefore, even in situations where, for example, the user's virtual avatar's actions within the virtual space should be hidden from other users (such as the virtual avatar entering a password that should be kept secret from other users), if the user makes an inappropriate selection (i.e., sets it to shared mode), the user's virtual avatar's actions may be seen by other users.

[0008] Therefore, one aspect of this disclosure aims to provide a content publishing system, method, and procedure that can effectively hide the actions of a user's virtual avatar in virtual space from other users, depending on the circumstances.

[0009] Problem Solving Methods

[0010] One aspect of this disclosure relates to a content publishing system that publishes content from a virtual space to multiple user terminals, and includes at least one processor. The at least one processor detects a specific situation, namely, that a virtual avatar configured within the virtual space corresponding to user 1 performs a pre-defined specific action, which should be hidden from user 2 who is different from user 1; if the specific situation is detected, the content image from the virtual space is displayed on user 2's user terminal in a manner that makes the specific action visually unrecognizable.

[0011] Invention Effects

[0012] As can be seen from one aspect of this disclosure, a content publishing system, content publishing method, and content publishing procedure can be provided that can effectively hide the actions of a user's virtual avatar in virtual space from other users, depending on the circumstances. Attached Figure Description

[0013] Figure 1 This is an example diagram illustrating the content publishing system involved in the embodiment.

[0014] Figure 2 express Figure 1 The diagram shows an example of the hardware structure related to the content publishing system.

[0015] Figure 3 express Figure 1 The diagram shows an example of the functional structure of the content publishing system.

[0016] Figure 4 express Figure 1 The diagram shows a sequence of actions for the content publishing system.

[0017] Figure 5 An example diagram representing the virtual space involved in the first content image.

[0018] Figure 6 A schematic diagram illustrating the second content image involved in the first generation process.

[0019] Figure 7 A schematic diagram illustrating the second content image involved in the second generation process.

[0020] Figure 8 A schematic diagram illustrating the second content image involved in the third generation process.

[0021] Explanation of symbols

[0022] 1: Content publishing system; 10: Server; 11: Receiving unit; 12: Detection unit; 13: Generation unit; 14: Sending unit; 20, 30: User terminals; 21: Acquisition unit; 22: Sending unit; 23: Receiving unit; 24: Display control unit; 40: Virtual object (specific object, non-shared object); 101: Processor; A: Virtual avatar; DB: Content database; P1: Server program; P2: Client program; V: Virtual space

[0023] Invention Embodiments

[0024] The embodiments disclosed herein are described in detail below with reference to the accompanying drawings. Furthermore, the same or equivalent elements are referred to by the same symbols in the description of the drawings, and repetitive descriptions are omitted.

[0025] [System Overview]

[0026] The content publishing system described in this embodiment is a computer system that publishes content to multiple users. Content is human-readable information provided by a computer or computer system. Electronic data representing content is called "content data." The presentation format of content is not limited. Content can be presented through, for example, images (such as photos, videos, etc.), text, sound, music, or any combination of two or more of these elements. Content can be used for various information transmission or communication. Content can be applied to various scenarios or purposes such as entertainment, news, education, healthcare, games, chat, business transactions, speeches, seminars, and training. Publishing refers to the process of sending information to users through communication networks or broadcast networks.

[0027] The content publishing system provides content to users by sending content data to user terminals. In this embodiment, content presenting the same virtual space is provided to the terminals of multiple users. Therefore, the same virtual space can be shared among multiple users. Furthermore, in this embodiment, at least an image representing the virtual space is used when presenting content. In other words, the content data includes at least a content image representing the content. A content image is an image that humans can visually recognize as containing certain information. Content images can be either dynamic images (videos) or static images.

[0028] In this embodiment, the content image presents a virtual space containing virtual objects. Virtual objects are objects that do not exist in the real world but are only presented on a computer system. Virtual objects are presented using image assets independent of live-action images, through two-dimensional or three-dimensional computer graphics (CG). The method of presenting virtual objects is not limited. For example, virtual objects can be presented using animated assets or realistically based on live-action images. The virtual space is a virtual two-dimensional or three-dimensional space presented through images displayed on a computer. The content image, for example, is an image representing a landscape visible from a virtual camera positioned within the virtual space. The virtual camera is positioned within the virtual space, corresponding to the user's line of sight when viewing the content image. The content image or virtual space may also include real-world objects, i.e., objects that actually exist in the real world.

[0029] For example, a user's avatar, or virtual avatar, is a type of virtual object. Besides directly using the subject, virtual avatars can also use image assets independent of the original image, presented through two-dimensional or three-dimensional computer graphics (CG). The presentation method of virtual avatars is unlimited. For example, virtual avatars can be presented using animated assets or based on real-life images in a realistic manner. Furthermore, the position and orientation of the virtual camera can be consistent with the virtual avatar's perspective and line of sight, in which case a first-person perspective image is provided to the user. Alternatively, the position and orientation of the virtual camera can be inconsistent with the virtual avatar's perspective and line of sight; for example, the virtual camera can be positioned in the space behind the virtual avatar, in which case a third-person perspective image is provided to the user. By viewing the content images, users can experience augmented reality (AR), virtual reality (VR), or mixed reality (MR).

[0030] In this disclosure, the description of "the first computer 'sending' data or information to the second computer" means that the transmission is intended to ultimately deliver the data or information to the second computer. In other words, the above description includes situations where other computers or communication devices relay the data or information in this transmission.

[0031] The purpose and application scenarios of the content are not limited. In this embodiment, for example, the content provides users with an experience identical to that in reality within virtual facilities set up in a virtual space shared by multiple users. For example, the content can provide users with the experience of shopping in shopping facilities set up in the virtual space, or it can provide users with a game experience in the virtual space (such as VR escape games).

[0032] [Overall Structure of the Content Publishing System]

[0033] Figure 1 This is an example diagram illustrating a content publishing system 1 according to an embodiment. In this embodiment, the content publishing system 1 includes a server 10, multiple user terminals 20 and 30, and a content database DB.

[0034] Server 10 is a computer that publishes content data to user terminals 20 and 30. Server 10 connects to each user terminal 20 and 30 and the content database DB via a communication network N. The structure of the communication network N is not limited. For example, the structure of the communication network N may include the Internet or an intranet.

[0035] User terminals 20 and 30 are computers used by users who utilize content. In this embodiment, user terminals 20 and 30 have the following functions: capturing video, accessing the content publishing system 1 to send electronic data (video data) representing the video, and receiving and displaying content data from the content publishing system 1. The type and structure of user terminals 20 and 30 are not limited. For example, user terminals 20 and 30 can be high-performance mobile phones (smartphones), tablet computers, wearable terminals (such as helmet displays (HMDs), smart glasses, etc.), laptops, mobile phones, and other portable terminals. User terminals 20 and 30 can also be fixed terminals such as desktop computers.

[0036] In this embodiment, user terminal 20 is the user terminal of one user (user 1) among multiple users (i.e., the user terminal used by user 1), and user terminal 30 is the user terminal of a user different from user 1 (user 2) (i.e., the user terminal used by user 2). Figure 1 An example of two user terminals 30 is shown, but the number of user terminals 30 (i.e., the number of users 2) is not specifically specified. In this embodiment, as mentioned above, for ease of understanding, the user being referred to when focusing on a particular user is called user 1, and the other users are called user 2. Therefore, user terminals 20 and 30 have the same hardware and functional structure. In other words, each user terminal acts as user terminal 20 (mentioned later) in some situations and as user terminal 30 (mentioned later) in other situations.

[0037] By logging into the content publishing system 1 through user terminals 20 and 30, users can utilize the content. For example, users can use their virtual avatars to enjoy various experiences within the virtual space where the content is presented. In this embodiment, it is assumed that the user has already logged into the content publishing system 1.

[0038] The content database (DB) is a non-transitory memory medium or device that stores generated content data. In other words, the content database (DB) is a library for storing existing content. Content data is stored in the content database (DB) via server 10, user terminals 20 and 30, or any other computer.

[0039] After being associated with a unique content ID, the content data is stored in the content database DB. In this embodiment, the content data structure includes virtual space data, model data, and scenes.

[0040] Virtual space data is electronic data representing the virtual space that constitutes content. For example, virtual space data may include information representing the configuration of various virtual objects that constitute the background, the location of virtual cameras, or the location of virtual light sources.

[0041] Model data is electronic data used to define the style of virtual objects that constitute content. The style of a virtual object refers to the rules or methods used to control the virtual object. For example, the style of a virtual object includes at least one of its structure (such as shape and size), movement, and sound. The data structure of the model data for a virtual avatar is not limited and can be designed arbitrarily. For example, model data may include information about multiple joints and bones that constitute the virtual avatar, graphic data representing the virtual avatar's appearance design, virtual avatar attributes, and a virtual avatar identifier, i.e., the virtual avatar ID. Information about multiple joints and bones of the virtual avatar includes, for example, the three-dimensional coordinates of each joint and the combination of adjacent joints (i.e., bones). However, the structure of this information is not limited to this and can be designed arbitrarily. Virtual avatar attributes refer to any information required to set the characteristics of the virtual avatar, and may include, for example, nominal size, sound quality, or personality.

[0042] A scene refers to electronic data that defines the actions of virtual objects, virtual cameras, or virtual light sources within a virtual space over time. In essence, a scene is information used to determine the storyline of the content. The actions of virtual objects are not limited to visually recognizable actions but also include the generation of auditory recognizable sounds.

[0043] Content data may include information about real-world objects. For example, content data may include actual photographs showing real-world objects. If content data includes real-world objects, the scene may further define the time and location of the appearance of those objects.

[0044] The location of the content database DB is not limited. For example, the content database DB can be located in a computer system other than the content publishing system 1, or it can be a component of the content publishing system 1.

[0045] [Hardware Structure of the Content Publishing System]

[0046] Figure 2 This is an example diagram showing the hardware structure related to the content publishing system 1. Figure 2 The exhibition showcases a server computer 100 that acts as server 10 and a terminal computer 200 that acts as user terminal 20 or user terminal 30.

[0047] For example, the server computer 100 has the following hardware components: processor 101, main memory 102, auxiliary memory 103, and communication unit 104.

[0048] Processor 101 is an arithmetic unit that executes the operating system and applications. Common processors include CPUs (Central Processing Units) and GPUs (Graphics Processing Units), but processor 101 is not limited to these types. For example, processor 101 can also be a combination of sensors and dedicated circuits. Dedicated circuits can be programmable circuits like FPGAs (Field Programmable Gate Arrays), or other types of circuits.

[0049] The main memory unit 102 is a device that stores the programs required to implement the server 10, the calculation results output by the processor 101, and so on. The main memory unit 102 may be composed of ROM (Read Only Memory) or RAM (Random Access Memory).

[0050] The auxiliary memory unit 103 is typically a device with a larger data storage capacity than the main memory unit 102. The auxiliary memory unit 103 may be composed of non-volatile memory such as a hard disk or flash memory. The auxiliary memory unit 103 stores the server program P1 used to enable the server computer 100 to act as the server 10, and various data. For example, the auxiliary memory unit 103 may store data related to virtual objects such as virtual avatars and at least one of the following in virtual space. In this embodiment, the content publishing program is implemented as the server program P1.

[0051] The communication unit 104 is a device for conducting data communication with other computers through a communication network N. The communication unit 104 may be composed of a network interface card (NIC) or a wireless communication module.

[0052] By having the processor 101 or main memory 102 read the server program P1, the processor 101 executes the server program P1, thereby implementing the various functional elements of the server 10. The server program P1 includes the code required to implement the various functional elements of the server 10. The processor 101 runs the communication unit 104 according to the server program P1, performing data reading and writing processes in the main memory 102 or auxiliary memory 103. By executing the above processes, the various functional elements of the server 10 are realized.

[0053] Server 10 can consist of one or more computers. If multiple computers are used and connected through a communication network, they theoretically constitute one server 10.

[0054] For example, the terminal computer 200 has the following hardware components: processor 201, main memory 202, auxiliary memory 203, communication unit 204, input interface 205, output interface 206, and camera unit 207.

[0055] Processor 201 is an arithmetic unit that executes the operating system and applications. Processor 201 can be a CPU or a GPU, but the type of processor 201 is not limited to these.

[0056] The main memory unit 202 is a device that stores the programs required to implement user terminals 20 and 30, the calculation results output by processor 201, etc. The main memory unit 202 may be composed of ROM or RAM, etc.

[0057] The auxiliary memory unit 203 is typically a device with a larger data storage capacity than the main memory unit 202. The auxiliary memory unit 203 may be composed of non-volatile memory such as a hard disk or flash memory. The auxiliary memory unit 203 stores the client program P2 used to enable the terminal computer 200 to act as user terminals 20 and 30, and various data. For example, the auxiliary memory unit 203 may store data related to virtual objects such as virtual avatars, and at least one of them in virtual space.

[0058] The communication unit 204 is a device for conducting data communication with other computers through a communication network N. The communication unit 204 may be composed of a network card or a wireless communication module.

[0059] Input interface 205 is a device for receiving data based on user operations or actions. For example, input interface 205 may consist of at least one of a controller, keyboard, operation buttons, pointing device, microphone, sensor, and camera. The keyboard and operation buttons may be displayed on a touch panel. The type of input interface 205 is not limited, and correspondingly, the data input through input interface 205 is also not limited. For example, input interface 205 may accept data input or selected by a keyboard, operation buttons, or pointing device. Input interface 205 may also accept audio data input by a microphone. Input interface 205 may also accept image data (such as video data or still image data) captured by a camera. Input interface 205 may also accept data representing nonverbal activities of the user (such as gaze, gestures, facial expressions, etc.) detected by the motion capture function of a sensor or camera as motion data.

[0060] Output interface 206 is a device for outputting data processed by terminal computer 200. For example, output interface 206 may consist of at least one of a display, touch panel, HMD, and speaker. The display device, touch panel, HMD, etc., displays the processed data on a screen. The speaker outputs sound representing the processed sound data.

[0061] The camera unit 207 is a device for capturing images depicting the real world; specifically, it is a camera. The camera unit 207 can capture both moving images (video) and still images (photographs). When capturing moving images, by processing the video signal according to a given frame rate, the camera unit 207 acquires a series of frames arranged in sequence as video. The camera unit 207 can also function as an input interface 205.

[0062] By having the processor 201 or main memory 202 read and execute the client program P2, the various functional elements of user terminals 20 and 30 are implemented. The client program P2 includes the code required to implement the various functional elements of user terminals 20 and 30. The processor 201 executes the communication unit 204, input interface 205, output interface 206, or camera unit 207 according to the client program P2, performing data reading and writing processes in the main memory 202 or auxiliary memory 203. Through the execution of the above processes, the various functional elements of user terminals 20 and 30 are implemented.

[0063] At least one of the server program P1 and the client program P2 may be permanently stored in a physical memory such as a CD-ROM, DVD-ROM, or semiconductor memory before being provided. At least one of the above programs may be provided as a data signal superimposed with a carrier wave through a communication network. The above programs may be provided separately or simultaneously.

[0064] [Functional Structure of the Content Publishing System]

[0065] Figure 3 This is an example diagram illustrating the functional structure of the content publishing system 1. The server 10 has the following functional elements: a receiving unit 11, a detection unit 12, a generation unit 13, and a sending unit 14.

[0066] The receiving unit 11 receives data signals sent by the user terminal 20. The data signals may include at least one of action information and operation information. Action information refers to information defining the actions of the virtual avatar (hereinafter referred to as "virtual avatar") configured in the virtual space corresponding to user 1. Operation information refers to instruction information for executing events that are not virtual avatar actions (such as launching the settings screen).

[0067] The detection unit 12 detects specific situations in which the virtual avatar performs a specific action based on the data signal received from the user terminal 20. A specific action is an action predetermined to be hidden from user 2. For example, an action in which user 1 enters information they do not want other users (user 2) to know (such as a PIN code or password) (e.g., pressing an operation button on a virtual input device configured in the virtual space with the virtual avatar's finger) is a specific action. In addition to the actual execution of a specific action, specific situations may also include situations in which a specific action is about to be performed (i.e., just before the specific action is about to be performed).

[0068] Based on the detection results from the detection unit 12, the generation unit 13 generates content data for distribution to each user (i.e., each user terminal 20 and 30). The content data includes content image data related to the content image to be displayed on the display devices of the user terminals 20 and 30. The content data may also include non-image data (such as sound). The transmission unit 14 transmits the content data generated by the generation unit 13 to each user terminal 20 and 30.

[0069] User terminal 20 has the following functional elements: acquisition unit 21, transmission unit 22, reception unit 23, and display control unit 24.

[0070] The acquisition unit 21 acquires action information or operation information received through the input interface 205 of the user terminal 20. Action information is, for example, the action data described above. In this case, the actions of user 1 in the real space are reflected in the actions of the virtual avatar in the virtual space. Action information can also be information representing the content of a specified input operation performed by the user on the controller. In this case, the action corresponding to the input operation content is reflected as the action of the virtual avatar, and the actions of user 1 in the real space are not directly reflected in the actions of the virtual avatar. Therefore, the action information defining the actions of the virtual avatar can either reflect the actual actions of user 1 or not. For example, information such as causing a virtual object (a non-shared object mentioned later) to appear in the virtual space for inputting passwords such as PIN codes, and indicating this operation, is a type of operation information.

[0071] The sending unit 22 sends the action information or operation information obtained by the acquiring unit 21 to the server 10. The receiving unit 23 receives content data, including content image data, from the server 10. The display control unit 24 displays the functional elements of the content on the display device of the user terminal 20 based on the content data received by the receiving unit 23.

[0072] As described above, user terminal 30 and user terminal 20 have the same functional elements. Furthermore, this embodiment focuses on the processing when user terminal 30 of user 2 displays content including the virtual space of user 1's virtual avatar; therefore, Figure 3 Only the receiving unit 23 and the display control unit 24, which are used to perform the processing, are shown.

[0073] [Actions of the content publishing system]

[0074] The following reference Figure 4 This describes the actions of the content publishing system 1 (more specifically, the actions of the server 10), and the content publishing method involved in this embodiment. Figure 4 This is a sequence diagram illustrating the actions of content publishing system 1.

[0075] First, the acquisition unit 21 of user terminal 20 of user 1 acquires the input information of user 1. Specifically, the acquisition unit 21 acquires the aforementioned action information or operation information (step S1). Next, the transmission unit 22 of user terminal 20 sends the action information or operation information acquired by the acquisition unit 21 to server 10 (step S2). This action information or operation information is received by the receiving unit 11 of server 10.

[0076] Next, the generation unit 13 of the server 10 generates first content data based on the action information or operation information obtained by the receiving unit 11 (step S3). The first content data includes first content image data. If the receiving unit 11 obtains action information, the generation unit 13 generates first content image data that presents a virtual space, which includes a virtual avatar that moves based on the action information. If the receiving unit 11 obtains operation information, the generation unit 13 generates first content image data that presents a virtual space, which has been changed based on the operation information. If the action of the virtual avatar acts on a virtual object configured in the virtual space (e.g., a part of the virtual avatar comes into contact with another virtual object), the generation unit 13 can calculate the action in the virtual space caused by the action (e.g., movement or deformation of the virtual avatar or other virtual objects). At this time, the first content image data may include information about the virtual space that reflects the calculated action (i.e., the state of each virtual object that reflects movement or deformation).

[0077] The first content image data is data related to the content image presented in the virtual space, reflecting the state of the virtual avatar of user 1's action information (i.e., the virtual avatar's action corresponding to user 1's action information) and its visibility in the virtual space. The first content image data can be the content image itself or the data used to generate the content image. In the former case, the first content image data is the content image itself generated through rendering (i.e., rendered data), which is based on information about the state of each virtual object (including the virtual avatar) within the virtual space. In the latter case, the first content image data is the basic data used to generate the content image through rendering (i.e., pre-rendering data).

[0078] Figure 5 This is an example diagram representing the virtual space involved in the first content image. Figure 5 This example illustrates a scenario where user 1 makes a purchase (checkout) within a virtual space V using a virtual avatar A corresponding to user 1. In this example, virtual avatar A is operating a virtual object 40, a device that simulates a password (such as a PIN code), to make the purchase (checkout) within the virtual space V. Specifically, by moving virtual avatar A's hand A1 to press an input button 41 located on the virtual object 40, information (such as numbers) corresponding to the pressed input button 41 is entered. The first content image presents an image of the virtual space V reflecting the actions of the aforementioned virtual avatar A. In other words, if the shooting range corresponding to the position and direction of the virtual camera includes virtual avatar A's hand A1, the actions of virtual avatar A's hand A1 are visible in the first content image.

[0079] There is no problem when the first content image reflecting the actions of virtual avatar A is provided by the user corresponding to virtual avatar A (i.e., user 1). Furthermore, in order to accurately perform the password input operation using virtual avatar A, user 1 needs to view the first content image to confirm the finger movement of virtual avatar A corresponding to their own finger movement (or the specified operation performed on the controller). On the other hand, if the finger movement of virtual avatar A is seen by user 2 who is not user 1 (i.e., user 1's password is being viewed), a security problem exists. Therefore, server 10 performs the following processing.

[0080] As described above, it is preferable to provide user 1 with a first content image that reflects the actions of virtual avatar A. Therefore, server 10 sends the first content data to user terminal 20 of user 1. Specifically, sending unit 14 sends the first content data to user terminal 20 (step S4). This first content data is received by receiving unit 23 of user terminal 20. Then, display control unit 24 of user terminal 20 displays the content image on the display device by processing the first content image data included in the first content data (step S5). If rendering is performed on server 10 (i.e., the first content image data is the content image itself), display control unit 24 can directly display the content image. On the other hand, if rendering is not performed on server 10, display control unit 24 can generate and display the content image by performing rendering based on the first content image data.

[0081] On the other hand, such as Figure 5 As shown, when a virtual avatar A performs an action (a specific action) that should be hidden from user 2 within the virtual space V (a specific situation), for security reasons, it is best not to provide user 2 with content images that reflect the specific action of virtual avatar A. Therefore, firstly, the detection unit 12 of server 10 detects the specific situation, that is, virtual avatar A performs a specific action (step S6). Furthermore, information defining the specific action or specific situation is stored in advance in a location accessible to server 10 (such as the content database DB, auxiliary memory unit 103, etc.).

[0082] If the detection unit 12 detects a specific situation (step S6: Yes), the generation unit 13 generates second content data, which includes second content image data related to the content image of the virtual space V. At this time, the specific action cannot be visually recognized (step S7). Then, the sending unit 14 sends the second content data to the user terminal 30 of the user 2 (step S8). The second content data is received by the receiving unit 23 of the user terminal 30. Then, the display control unit 24 of the user terminal 30 displays the content image on the display device by processing the second content image data included in the second content data (step S10). If rendering is performed on the server 10 (i.e., the second content image data is the content image itself), the display control unit 24 can directly display the content image. On the other hand, if rendering is not performed on the server 10, the display control unit 24 can generate and display the content image by performing rendering based on the second content image data. Thus, by providing the user terminal 30 with a second content image in which the specific action of the virtual avatar cannot be visually recognized, the specific action content can be kept confidential from the user 2. Ultimately, this prevents User 1's confidential information from being leaked to User 2, effectively ensuring security within the virtual space.

[0083] Furthermore, if the detection unit 12 does not detect a specific situation (step S6: No), the generation unit 13 does not need to generate content data for user 2 (i.e., data related to the content image that has concealed the specific action). Therefore, the process of generating the second content data by the generation unit 13 is omitted at this time (step S7), and the sending unit 14 sends the first content data to user terminal 30 of user 2 (step S9). Then, in step S10, the content image corresponding to the first content image data is displayed on the display device.

[0084] Next, several examples of the detection process performed by the detection unit 12 in step S6 above (the first detection process to the third detection process) will be described.

[0085] (First detection and processing)

[0086] In the first detection process, the specific action (operation) must be predefined as an action (operation) directed at a pre-defined specific virtual object (hereinafter referred to as the "specific object"). The specific object is the virtual object to which the specific action performed by the virtual avatar is directed. For example... Figure 5 As shown, if the virtual object 40 is predetermined as a specific object, the input operation of the input button 41 on the virtual object 40 can be predetermined as a specific action. At this time, the detection unit 12 can detect the case where the virtual avatar A performs a specific action on the virtual object 40 (here referring to the input operation on the input button 41) as a specific case.

[0087] For example, based on the position of a specific object configured in the virtual space V and the position of the virtual avatar A in the virtual space V, the detection unit 12 detects a state where the virtual avatar is configured within a predetermined distance from the specific object, and can detect specific situations after detecting this state. Figure 5 As shown, the detection unit 12 calculates, for example, the distance d1 between the position of the virtual object 40 (such as the position coordinates of the input button 41 within the virtual space V) and the position of the virtual avatar A (such as the position coordinates of the hand A1 of the virtual avatar A within the virtual space V). Then, the detection unit 12 compares this distance d1 with a pre-set threshold Th, and can detect a specific situation when the distance d1 is less than the threshold Th (or the distance d1 is insufficient to reach the threshold Th). In this case, by setting the threshold Th to a larger value, the specific situation can be detected before the virtual avatar A actually begins to perform the specific action.

[0088] (Second detection process)

[0089] In the second detection process, specific actions (operations) for virtual objects visible only to User 1 (hereinafter referred to as "non-shared objects") must be predefined. For example, after receiving operation information related to a specified operation from User 1 (such as performing a predefined operation on the controller (input interface 205) of user terminal 20), server 10 may subsequently cause the non-shared object to appear in the virtual space. The non-shared object is an object visible only to User 1, and is a virtual object controlled not to be displayed in the content image published to User 2. Furthermore, the non-shared object is a virtual object that only accepts operations performed by User 1 through a virtual avatar.

[0090] like Figure 5 As shown, virtual object 40 is a non-shared object generated in virtual space V triggered by an operation specified by user 1. Here, the appearance of virtual object 40 in virtual space V, which is both the operation object of virtual avatar A and a non-shared object, means that virtual avatar A is about to perform an operation (specific action) on this non-shared object. Therefore, the detection unit 12 can detect the specific situation after the non-shared object, i.e., virtual object 40, appears in virtual space V. Alternatively, the specific situation can be detected before the moment when virtual avatar A actually begins to perform the specific action.

[0091] (Third detection process)

[0092] In the third detection process, a template for a specific action is defined and stored in advance in a location accessible to the server 10 (such as the content database DB, auxiliary memory unit 103, etc.). For example, a pattern that assigns characteristics to the displacement of the hand A1 of the virtual avatar A when performing a password input operation is a template. For example, the template corresponding to the above action is information representing the action pattern of the virtual avatar A's hand A1 pointing its fingertips to multiple different locations consecutively. The template only needs to be able to calculate its similarity to the actual action of the virtual avatar A (i.e., the action information received from the user terminal 20 in step S2), and the data format of the template is not limited to a specific format. At this time, by comparing the action information obtained in step S2 with the template, the detection unit 12 detects the action information defining the specific action (hereinafter referred to as "specific action information"). Then, after detecting the specific action information, the detection unit 12 detects a specific situation.

[0093] For example, the detection unit 12 can calculate the similarity between the action information obtained in step S2 and the template through a specified calculation process. Then, by comparing the similarity with a pre-set threshold, the detection unit 12 determines whether the action information obtained in step S2 is specific action information. Specifically, if the similarity is greater than the threshold (or exceeds the threshold), the detection unit 12 can determine that the action information obtained in step S2 is specific action information. Then, if specific action information (i.e., the action information obtained in step S2) is detected through the above steps, the detection unit 12 can detect a specific situation.

[0094] Next, several examples of the generation process performed by the generation unit 13 in step S7 above (generation process 1 to generation process 3) will be described.

[0095] (First generation process)

[0096] In the first generation process, the generation unit 13 generates second content image data that excludes specific action information from the action information defining the action of virtual avatar A within the virtual space V. If the second content image data is pre-rendering data, it is information that excludes the specific action information obtained in step S2. For example, the second content data includes information from which the specific action information has been excluded from the action information obtained in step S2; thus, the generation unit 13 can generate second content image data that excludes the specific action information. On the other hand, if the second content image data is post-rendering data (i.e., the content image itself), it is a content image generated based on information from which the specific action information has been excluded from the action information obtained in step S2. For example, by determining the action of virtual avatar A based on information from which the specific action information has been excluded from the action information obtained in step S2, and generating a content image reflecting the action of virtual avatar A, the generation unit 13 can generate post-rendering second content image data that excludes the specific action information.

[0097] In any of the above scenarios, server 10 does not send specific action information to user terminal 30. Ultimately, the display device of user terminal 30 displays a second content image whose specific action of virtual avatar A cannot be visually identified (i.e., the specific action of virtual avatar A is not presented). Furthermore, the second content image data sent to user terminal 30 itself does not include specific action information; even if user 2 parses the second content image data, they cannot grasp the specific action of virtual avatar A. In other words, the specific action of virtual avatar A cannot be visually identified in the second content image displayed on the display device of user terminal 30, and even if the second content image data is parsed, the specific action of virtual avatar A cannot be grasped. Therefore, as can be seen from the second content image data generated in the first generation process, the confidentiality (security) of the specific action is effectively ensured.

[0098] Furthermore, after excluding all action information from the moment a specific situation is detected until the moment the specific situation is no longer detected from the action information obtained in step S2, the generation unit 13 can generate second content image data based on this information. For example, when performing the first detection process described above, the generation unit 13 can first exclude action information related to the action from the moment a specific situation is detected until the specific action is actually performed (such as the preparatory action of approaching the virtual object 40 in order to press the input button 41), and then generate the second content image data. At this time, in addition to the specific action of the virtual avatar, the preparatory action required to perform the specific action can also be hidden from the user 2. As a result, the confidentiality of the specific action can be further improved.

[0099] Figure 6 This is a schematic diagram illustrating the second content image involved in the second content image data generated in the first generation process. For example, through the first detection process, after the detection unit 12 detects that the hand A1 of the virtual avatar A is within a threshold distance range of the input button 41 of the virtual object 40, a specific situation is detected. Then, the generation unit 13 generates the second content image data, without using the action information related to the action of the virtual avatar A after the specific situation was detected (i.e., the action of approaching the virtual object 40 and pressing the input button 41 with hand A1). Finally, the virtual space V (refer to...) is generated and presented. Figure 6 The second content image data, in this virtual space V, shows that the specific actions of virtual avatar A and the aforementioned preparatory actions are not visually recognizable. In other words, in this example, the second content image does not present the actions of virtual avatar A after the moment the specific situation is detected. Therefore, a second content image (here referring to the image where virtual avatar A stops at the moment the specific situation is detected) that is out of sync with the first content image provided to user 1 (an image reflecting the actual actions of virtual avatar A) is provided to user 2. Furthermore, if virtual object 40 is the aforementioned non-shared object, virtual object 40 is not displayed in the second content image. Additionally, if the detection unit 12 performs the second detection process, the generation unit 13 may, when generating the second content image data, not use the virtual avatar action information from the moment the non-shared object appears in the virtual space until it disappears from the virtual space. This is also as... Figure 6 As shown, the image of the virtual avatar that stops at a certain moment (here referring to the moment when the non-shared object appears in the virtual space) is provided to the user 2.

[0100] As described above, by providing user 2 with a second content image showing that the virtual avatar A stops at the moment a specific situation is detected, the specific action of the virtual avatar A can be hidden from user 2. However, user 2 will see the virtual avatar in an unnatural stopping state, which may make user 2 feel uncomfortable and affect their immersion in the virtual space V. Therefore, the generation unit 13 can perform the following second generation process.

[0101] (Second generation process)

[0102] In the second generation process, the generation unit 13 generates second content image data in which a configured object occludes a specific action. This object is one that at least occludes the portion involved in the specific action of the virtual avatar. For example, a second content image in which this second content image data relates is obtained by overlaying a mosaic object onto a content image that presents the action of virtual avatar A based on the action information (including specific action information) obtained in step S2. At this time, if the detection unit 12 detects a specific situation, the server 10 can display the second content image in which the configured object occludes the specific action on the user terminal 30 of user 2.

[0103] Figure 7 This is a schematic diagram illustrating the second content image involved in the second content image data generated in the second generation process. For example... Figure 7 As shown, a circular mosaic object M is overlaid to obscure the portion of the virtual avatar A involved in a specific action (here referring to the area including hand A1). At this time, a harmonious image (an image where the virtual avatar A does not stop unnaturally) can be provided to user 2, while the portion of the virtual avatar A involved in a specific action can be hidden through the mosaic object M. However, in the second generation process, the second content image data includes the virtual avatar A's action information (including specific action information). Therefore, by parsing the second content image data, user 2 may grasp the content of the specific action. Therefore, the generation unit 13 can perform the following third generation process, which combines the advantages of the first and second generation processes.

[0104] (Third generation process)

[0105] In the third generation process, the generation unit 13 generates second content image data, in which the presented virtual avatar performs human model actions instead of a specific action. This second content data, like the second content data generated in the first generation data, does not include specific action information. Specifically, this second content data includes human model action information representing human model actions, rather than the action information actually obtained in step S2. The virtual avatar's human model actions are, for example, pre-stored in a location accessible to the server 10 (such as the content database DB, auxiliary memory unit 103, etc.). At this time, if the detection unit 12 detects a specific situation, the server 10 can display the second content image on the user terminal 30 of user 2, in which the presented virtual avatar performs human model actions instead of a specific action.

[0106] Figure 8 This is a schematic diagram illustrating the second content image involved in the second content image data generated in the third generation process. For example... Figure 8 As shown, the virtual avatar A performs human model actions (here referring to the action of virtual avatar A stopping to drink a beverage) instead of actual actions (here referring to...). Figure 5 (The action of entering the password is shown). At this time, a coordinated image can be provided to user 2, while the specific actions of the virtual avatar A can be hidden from user 2. Moreover, since the second content image data does not include specific action information, the confidentiality of the specific actions is effectively ensured, just like the second content image data generated in the first generation process described above.

[0107] [Effect]

[0108] As explained above, one aspect of this disclosure relates to a content publishing system that publishes content from a virtual space to multiple user terminals, and includes at least one processor. The at least one processor detects a specific situation: the virtual avatar configured within the virtual space corresponding to user 1 performs a pre-defined specific action, which should be hidden from user 2, who is different from user 1. If the specific situation is detected, when user 2's user terminal displays the content image from the virtual space, the specific action cannot be visually recognized.

[0109] One aspect of this disclosure relates to a content publishing method executed by a content publishing system having at least one processor. The content publishing method includes the following steps: detecting a specific situation, whereby a virtual avatar configured within a virtual space corresponding to user 1 performs a pre-defined specific action to hide from user 2 who is different from user 1; and, upon detecting the specific situation, displaying a content image of the virtual space on user 2's user terminal, wherein the specific action cannot be visually identified within the content image.

[0110] One aspect of this disclosure relates to a content publishing procedure that causes a computer to perform the following steps: a step of detecting a specific situation, wherein the specific situation refers to a virtual avatar configured in a virtual space corresponding to user 1 performing a specific action that is pre-defined to hide from user 2 who is different from user 1; and a step of displaying a content image of the virtual space on user 2's user terminal when the specific situation is detected, wherein the specific action cannot be visually identified in the content image.

[0111] In the above aspects, after detecting a specific situation, namely, the virtual avatar performs a specific action to hide from other users (user 2) in the view of user 1, it then provides user 2 with a content image (the second content image in the above embodiment) that presents the virtual space, in which the specific action cannot be visually identified.

[0112] Therefore, the actions of User 1's virtual avatar in the virtual space can be effectively hidden from other users as needed. In other words, User 1 does not need to pre-set whether to share virtual avatar actions with other users, and the content images provided to User 2 can display virtual avatar actions that do not need to be hidden from other users, while not displaying virtual avatar actions (specific actions) that must be hidden from other users.

[0113] As can be seen from the above embodiments, if a specific action is to input user 1's confidential information (such as the PIN code of a bank card or credit card) in a virtual space, the security of the virtual space can be effectively ensured by keeping the above action confidential to user 2.

[0114] In addition, in VR escape games and similar scenarios, a user's act of answering questions posed in the game within a designated area of ​​a virtual space (such as answering questions using a virtual avatar on a virtual object simulated as a whiteboard within the virtual space, or providing hints for the answer through the avatar's gestures) can also be considered a specific action. In this case, the answering action performed by the virtual avatar can be pre-defined as a specific action. For example, after detecting that the virtual avatar has entered the pre-defined answering area within the virtual space, a specific situation can be detected. Based on this structure, it is possible to effectively prevent user 1's answer from being seen by user 2, thereby ensuring both the entertainment value and fairness of the content.

[0115] In addition, actions that are inappropriate to display to others (such as lewd gestures made when provoking others) can also be considered specific actions. These actions can also be pre-defined as specific actions. In this case, it is important to avoid displaying indecent actions performed by User 1 using a virtual avatar to User 2. This will prevent User 2 from feeling uncomfortable.

[0116] In the content publishing system, at least one processor may, at least not, send specific action information defining a specific action from the action information defining the actions performed by the virtual avatar in the virtual space to User 2's user terminal. In other words, the first generation process of the above embodiment can be executed. At this time, the data sent to User 2's user terminal does not include specific action information, thus effectively ensuring the confidentiality of the specific action.

[0117] In the content publishing system, at least one processor detects the state where the virtual avatar is positioned within a pre-defined distance from the specific object, based on the location of the specific object targeted by the specific action within the virtual space and the location of the virtual avatar within the virtual space. Upon detecting this state, a specific situation can be detected. In other words, the first detection process of the above embodiment can be executed. At this time, based on the location of the specific object and the location of the virtual avatar, the specific situation can be easily detected. Furthermore, by setting the aforementioned distance range (threshold) to a large value, the specific situation can be detected before the virtual avatar actually begins to perform the specific action. Therefore, the entire specific action can be reliably kept confidential from user 2.

[0118] In the content publishing system, the specific action may further include operations performed by the virtual avatar on a non-shared object configured within the virtual space and visible only to User 1. Additionally, at least one processor can detect the specific situation after the non-shared object appears in the virtual space. In other words, the second detection process described in the above embodiment can be executed. At this time, the specific situation can be easily detected after the non-shared object appears in the virtual space (e.g., it has already been generated in the virtual space based on User 1's operation). Furthermore, the specific situation can be detected in advance, before the actual start of operations on the non-shared object, thus ensuring that the entire specific action is kept confidential from User 2.

[0119] Furthermore, the above embodiment (second detection process) shows an example where the virtual object 40 is a non-shared object. However, the non-shared object does not necessarily have to simulate a real object; it could also be, for example, a window that floats in front of the user 1's virtual avatar. Additionally, the non-shared object is not necessarily an object used to input information that should be kept confidential from other users (user 2). Even in such cases, by treating the operation performed on the non-shared object through the virtual avatar as a specific action and keeping it confidential from user 2, the following effect can be achieved. In other words, it can be hidden from user 2 the incomprehensible action that the virtual object appears to be performing on thin air (the space where the non-shared object is configured in user 1's viewpoint). Ultimately, user 2 can avoid feeling uncomfortable and avoid affecting user 2's immersion in the virtual space.

[0120] In the content publishing system, at least one processor can detect specific action information by comparing the action information defining the virtual avatar action obtained from user 1's user terminal with a pre-prepared template. After detecting the specific action information, a specific situation is then detected. In other words, the third detection process of the above embodiment can be executed. At this time, by pre-preparing a template corresponding to the virtual avatar action (specific action) that is to be detected as a specific action, any action of the virtual avatar can be detected as a specific action, and at the same time, the situation of performing the specific action can be detected as a specific situation.

[0121] In the content publishing system, if a specific situation is detected, at least one processor can display a content image on user 2's user terminal, where the presented virtual avatar performs human model actions in place of the specific action. In other words, the third generation process of the above embodiment can be executed. At this time, the confidentiality of the specific action can be ensured while providing a coordinated content image to user 2.

[0122] In a content publishing system, if a specific condition is detected, at least one processor can display a content image on user 2's user terminal, where an object is configured to occlude a specific action. In other words, the second generation process of the above embodiment can be executed. At this time, the confidentiality of the specific action is ensured by using the object that occludes the specific action. Furthermore, the object that occludes the specific action is not limited to the mosaic object M shown in the above embodiment (see...). Figure 7 For example, besides circles, the shapes of the objects described above can also be rectangles or other shapes. Furthermore, the form of the objects is not limited to mosaics. For example, the objects can also be composed of any objects that simulate any image such as a smiley face, or any decorations such as stars or hearts.

[0123] [Variation Example]

[0124] The present disclosure has been described in detail above based on the embodiments. However, the present disclosure is not limited to the above embodiments. Various modifications can be made to the present disclosure without departing from its spirit.

[0125] In the above embodiments, the content publishing system 1 uses a server 10 in its structure, but the content publishing system is also applicable to direct publishing between user terminals without using a server 10. In this case, the functional elements of the server 10 can be implemented on any user terminal or on multiple user terminals respectively. Correspondingly, the content publishing program can also be implemented as a client program. The content publishing system can use a server or not in its structure.

[0126] Furthermore, some functions of the aforementioned server 10 can be performed by user terminals 20 and 30. For example, the processing of the detection unit 12 of server 10 can be performed by user terminal 20. In this case, the sending unit 22 of user terminal 20 can send action information to server 10, wherein specific action information related to specific actions of the virtual avatar has been excluded. Through the above structure, the same effect as the content publishing system 1 described above can also be obtained.

[0127] In this disclosure, the description of "at least one processor executes the first process, executes the second process... executes the nth process" or a corresponding description includes the case where the executing entity (i.e., the processor) of the n processes from the first process to the nth process changes midway. In other words, the description includes two scenarios: one is that all n processes are executed by the same processor; the other is that the processor changes arbitrarily among the n processes.

[0128] The method executed by at least one processor may have a processing order not limited to the above embodiments. For example, some of the above steps (processes) may be omitted, or the steps may be executed in a different order. In addition, any two or more of the above steps may be combined, some steps may be modified or deleted, or other steps may be added to the above steps before execution.

Claims

1. A content publishing system, characterized in that, It is a content publishing system used to publish content that presents virtual space to multiple user terminals, and has at least one processor; The at least one processor detects a specific situation, namely, the virtual avatar configured in the virtual space corresponding to user 1 performs a pre-defined specific action, and the specific action should hide user 2 who is different from user 1; If the specific situation is detected, the content image of the virtual space will be displayed on the user terminal of user 2 in a manner that makes the specific action visually unrecognizable. The specific action is the action of inputting the user 1's confidential information into the input button of a specific object in the virtual space. The specific object is the virtual object pointed to by the specific action of the virtual avatar. The specific action is also the action of the user 1 answering a question raised in the game in a designated area in the virtual space.

2. The content publishing system as described in claim 1, characterized in that, The at least one processor may at least not send the specific action information defining the specific action from the action information defining the action performed by the virtual avatar in the virtual space to the user terminal of the user 2.

3. The content publishing system as described in claim 1 or claim 2, characterized in that, The at least one processor detects, based on the location of the specific object configured within the virtual space and the location of the virtual avatar within the virtual space, that the specific action points to, and the location of the virtual avatar within the virtual space, a state in which the virtual avatar is configured within a pre-defined distance range from the specific object. After the state is detected, the specific situation can then be detected.

4. The content publishing system as described in claim 1 or claim 2, characterized in that, The specific actions include operations performed by the virtual avatar on non-shared objects configured within the virtual space that are visible only to the user 1.

5. The content publishing system as described in claim 4, characterized in that, The at least one processor may detect the specific situation after the non-shared object appears in the virtual space.

6. The content publishing system as described in claim 1 or claim 2, characterized in that, The at least one processor detects the action information defining the specific action by comparing the action information obtained from the user terminal of user 1, which defines the virtual avatar action, with a pre-prepared template. After detecting the action information that defines the specific action, the specific situation is then detected.

7. The content publishing system as described in claim 1 or claim 2, characterized in that, If the specific situation is detected, the at least one processor causes the user terminal of user 2 to display the content image, wherein the presented virtual avatar performs human model actions instead of the specific actions.

8. The content publishing system as described in claim 1 or claim 2, characterized in that, If the specific situation is detected, the at least one processor causes the user terminal of user 2 to display the content image, wherein an object is configured to occlude the specific action.

9. A content publishing method, characterized in that, This is a content publishing method executed by a content publishing system with at least one processor, including the following steps: The step of detecting a specific situation, which refers to the virtual avatar configured in the virtual space corresponding to user 1 performing a pre-defined specific action to hide user 2 who is different from user 1; When the specific situation is detected, the step of displaying a content image of the virtual space on the user terminal of user 2, wherein the specific action cannot be visually identified in the content image, The specific action is the action of inputting the user 1's confidential information into the input button of a specific object in the virtual space. The specific object is the virtual object pointed to by the specific action of the virtual avatar. The specific action is also the action of the user 1 answering a question raised in the game in a designated area in the virtual space.

10. A content publishing program product that causes a computer to perform the following steps: The step of detecting a specific situation, which refers to the virtual avatar configured in the virtual space corresponding to user 1 performing a pre-defined specific action to hide user 2 who is different from user 1; When the specific situation is detected, the step of displaying a content image of the virtual space on the user terminal of user 2, wherein the specific action cannot be visually identified in the content image, The specific action is the action of inputting the user 1's confidential information into the input button of a specific object in the virtual space. The specific object is the virtual object pointed to by the specific action of the virtual avatar. The specific action is also the action of the user 1 answering a question raised in the game in a designated area in the virtual space.

Images