Information setting device
The information setting device addresses the limitation of conventional virtual space division by setting viewing information for three-dimensional objects, ensuring controlled viewability and stable object rotation visibility.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- NTT DOCOMO INC
- Filing Date
- 2022-12-21
- Publication Date
- 2026-04-27
AI Technical Summary
Conventional techniques for dividing virtual spaces into mask and non-mask areas fail to restrict the viewing of specific parts of virtual objects, limiting the ability to control the viewability of virtual objects.
An information setting device that acquires and sets viewing information for three-dimensional virtual objects, indicating viewable and non-viewable directions or regions, using normal vectors and attributes of viewers to manage viewing permissions.
The device effectively restricts the viewability of virtual objects, preventing access to unauthorized directions and areas, and eliminates the need for frequent adjustments to the viewer's field of view during object rotation.
Smart Images

Figure 0007851969000001 
Figure 0007851969000002 
Figure 0007851969000003
Abstract
Description
Technical Field
[0001] The present invention relates to an information setting device.
Background Art
[0002] Patent Document 1 discloses a technique for setting a mask area that restricts viewing of an image displayed on a user's display. When an image with a mask area set is displayed on the display, the user will pay attention to the non-mask area outside the mask area.
[0003] Patent Document 2 discloses a technique related to a system for rendering a three-dimensional virtual object in a three-dimensional virtual space. When the technique described in Patent Document 1 is applied to the virtual space described in Patent Document 2, a mask area and a non-mask area are set in the virtual space that the user views.
Prior Art Documents
Patent Documents
[0004]
Patent Document 1
Patent Document 2
Summary of the Invention
Problems to be Solved by the Invention
[0005] However, since the conventional technique divides the virtual space into a mask area and a non-mask area to restrict the user's viewing, it has not been possible to restrict the viewing of a part of the virtual object.
[0006] Therefore, an object of the present invention is to provide an information setting device that can restrict the viewability of a virtual object itself.
Means for Solving the Problems
[0007] An information setting device according to a first preferred embodiment of the present invention is an information setting device comprising: an acquisition unit that acquires a three-dimensional virtual object to be displayed in a virtual space; and a setting unit that sets viewing information indicating at least one of a viewable direction and a non-viewable direction for the three-dimensional virtual object.
[0008] An information setting device according to a second preferred embodiment of the present invention is an information setting device comprising an acquisition unit that acquires a three-dimensional virtual object to be displayed in a virtual space, and a setting unit that sets viewing information indicating whether or not each of a plurality of regions constituting the surface of the three-dimensional virtual object can be viewed. [Effects of the Invention]
[0009] According to the present invention, the accessibility of the virtual object itself can be restricted. [Brief explanation of the drawing]
[0010] [Figure 1] A diagram showing the overall configuration of Information Setting System 1. [Figure 2] A block diagram showing an example configuration of terminal device 10-K. [Figure 3] An explanatory diagram showing an example of how to configure browsing information. [Figure 4] An explanatory diagram showing an example of how to process virtual objects (VOs). [Figure 5] A block diagram showing an example configuration of server 20. [Figure 6] A sequence diagram showing the first operation of the information setting system 1. [Figure 7] A sequence diagram showing the second operation of information setting system 1. [Figure 8] An explanatory diagram showing an example of how to configure browsing information. [Figure 9] An explanatory diagram showing an example of how to process virtual objects (VOs). [Figure 10] A block diagram showing an example configuration of server 20A. [Figure 11] A table showing an example configuration of the prohibited image database ND. [Figure 12] A table showing an example configuration of the browsing information database VD. [Figure 13] A sequence diagram showing the first operation of the information setting system 1B. [Figure 14] A sequence diagram showing the second operation of the information setting system 1B. [Modes for carrying out the invention]
[0011] 1: First Embodiment The configuration of the information setting system 1, including the terminal device 10-K as an information setting device according to the first embodiment of the present invention, will be described below with reference to Figures 1 to 7.
[0012] 1-1: Configuration of the First Embodiment 1-1-1: Overall structure Figure 1 shows the overall configuration of the information setting system 1. As shown in Figure 1, the information setting system 1 comprises terminal devices 10-1, 10-2, ... 10-J, ... 10-K, ... 10-N, and a server 20. N is an integer greater than or equal to 1. J is an integer between 1 and N, and is between 1 and N. K is an integer between 1 and N, and is different from J. In this embodiment, terminal devices 10-1 to 10-N have the same configuration. However, terminal devices with different configurations may be included.
[0013] In the information setting system 1, terminal devices 10-1 to 10-N and server 20 are connected to each other via the communication network NET so that they can communicate with one another. Note that in Figure 1, user U J This shall utilize terminal device 10-J. Furthermore, user U K This shall utilize terminal device 10-K.
[0014] Server 20 distributes various data and content to terminal devices 10-1 to 10-N via the communication network NET.
[0015] Also, User U JUsing the terminal device 10-J, a three-dimensional virtual object is generated. The terminal device 10-J outputs the three-dimensional virtual object to the server 20. For the sake of simplicity of explanation below, an example in which one terminal device 10-J generates a three-dimensional virtual object and outputs the three-dimensional virtual object to the server 20 will be described. However, the terminal that generates the three-dimensional virtual object and the terminal that outputs the three-dimensional virtual object to the server 20 may be separate entities. The server 20 outputs the three-dimensional virtual object to the terminal device 10-K used by the user U K The user U K uses the terminal device 10-K to set the viewability of the three-dimensional virtual object. The server 20 distributes the three-dimensional virtual object whose viewability has been set by the user U K to the terminal devices 10-1 to 10-N as the above-mentioned content. As will be described later, instead of the user U K using the terminal device 10-K to set the viewability, the server 20 may automatically set the viewability.
[0016] As an example, the user U J is the producer of the three-dimensional virtual object, and the user U K may be the administrator of the information setting system 1. Alternatively, the user U K may be a member of a plurality of users who manage the information setting system 1 in a group. In these cases, for example, the account of the user U J may be an account linked as a management target to the account of the user U K as an administrator. In other words, the user U K may be the "parent" account, and the account of the user U J may be the "child" account. Alternatively, the user U K is not the administrator of the information setting system 1, but may be a user who sets the viewability to protect the content including the three-dimensional virtual object. Also, the user U K is the user U JIt may be the same person. That is, User U J =U K This may be the creator of the three-dimensional virtual object, as well as the user who sets the viewing permissions. In this case, terminal device 10-J and terminal device 10-K may be the same terminal device.
[0017] Terminal devices 10-1 to 10-N display a virtual space containing the three-dimensional virtual object on the display 14 described later. This virtual space is, for example, a celestial sphere. Terminal devices 10-1 to 10-N are preferably, for example, personal computers (PCs), smartphones, and tablets. Furthermore, if the mobile terminal 10-J is a device that generates three-dimensional virtual objects, terminal device 10-J may be, for example, a dedicated scanner. Also, as described later, the display 14 may be separate from terminal devices 10-1 to 10-N, and may be, for example, XR glasses, XR goggles, or an HMD (Head Mounted Display) employing XR technology.
[0018] 1-1-2: Terminal device configuration Figure 2 is a block diagram showing an example configuration of terminal device 10-K. Terminal device 10-K comprises a processing unit 11, a storage device 12, a communication device 13, a display 14, and an input device 15. Each element of terminal device 10-K is interconnected using one or more buses for communicating information.
[0019] The processing unit 11 is a processor that controls the entire terminal device 10-K. The processing unit 11 is configured using, for example, one or more chips. The processing unit 11 is configured using, for example, a central processing unit (CPU) that includes interfaces with peripheral devices, an arithmetic unit, and registers. Some or all of the functions of the processing unit 11 may be implemented using hardware such as a DSP, ASIC, PLD, and FPGA. The processing unit 11 executes various processes in parallel or sequentially.
[0020] The storage device 12 is a recording medium that can be read and written to by the processing device 11. The storage device 12 also stores multiple programs, including the control program PR1 executed by the processing device 11. Furthermore, the storage device 12 stores image information representing images displayed on the display 14. In particular, the storage device 12 stores image information used when generating virtual objects VO.
[0021] The communication device 13 is hardware acting as a transmitting and receiving device for communicating with other devices. The communication device 13 is also called, for example, a network device, a network controller, a network card, and a communication module. The communication device 13 may be equipped with a connector for wired connection and an interface circuit corresponding to the connector. The communication device 13 may also be equipped with a wireless communication interface. Examples of connectors and interface circuits for wired connection include products compliant with wired LAN, IEEE1394, and USB. Examples of wireless communication interfaces include products compliant with wireless LAN and Bluetooth®.
[0022] The display 14 is a device that displays images and text information. The display 14 displays various images under the control of the processing unit 11. For example, various display panels such as liquid crystal display panels and organic EL (Electro-Luminescence) display panels are preferably used as the display 14.
[0023] Note that the display 14 may be separate from the terminal device 10-K. In this case, the display 14 may be XR glasses, XR goggles, or an HMD employing XR technology that is connected to the terminal device 10-K and can communicate with the terminal device 10-K. Also, if the display 14 is XR glasses, XR goggles, or an HMD employing XR technology that is connected to the terminal device 10-K, then User U K The user attaches the display 14 to their head. KThe user U views the virtual space through a display 14 worn on their head. J The same applies to this matter.
[0024] Input device 15 is for user U K It accepts input from the input device. For example, the input device 15 includes a keyboard, touchpad, touch panel, or pointing device such as a mouse. Here, if the input device 15 includes a touch panel, it may also function as the display 14.
[0025] The processing unit 11 reads the control program PR1 from the storage device 12 and executes it. As a result, the processing unit 11 functions as an acquisition unit 111, a generation unit 112, a display control unit 113, a setting unit 114, an appearance processing unit 115, and an output unit 116.
[0026] The acquisition unit 111 acquires image information representing a virtual object from the server 20 via the communication device 13. In particular, the acquisition unit 111 acquires image information representing a virtual object from the server 20. J The acquisition unit 111 acquires image information showing a three-dimensional virtual object generated by the user U using terminal device 10-J. K Operation information indicating the content of the operation on the input device 15 is acquired. Note that in terminal device 10-J, not terminal device 10-K, the acquisition unit 111 is acquired by user U. J Operation information indicating the content of the operation on the input device 15 is obtained.
[0027] The generation unit 112 generates the user U data acquired by the acquisition unit 111 in terminal device 10-J, not terminal device 10-K. J Based on operation information indicating the content of the operation on the input device 15, a virtual object to be displayed in the virtual space is generated using image information stored in the storage device 12.
[0028] The display control unit 113 displays a virtual object on the display 14 using the image information acquired by the acquisition unit 111. In particular, the display control unit 113 displays the virtual object on the display 14. JThe terminal device 10-J generates a three-dimensional virtual object, which is then displayed on the display 14.
[0029] The setting unit 114 sets viewing information for the three-dimensional virtual object acquired by the acquisition unit 111, indicating at least one of the directions in which viewing is possible and directions in which viewing is not possible. More specifically, the setting unit 114 sets the above viewing information based on the operation information acquired by the acquisition unit 111.
[0030] Figure 3 is an explanatory diagram showing an example of how to set browsing information. As described above, the display 14 shows user U J A three-dimensional virtual object VO, generated using terminal device 10-J, is displayed. In the space shown in Figure 3, three-dimensional polar coordinates are set, represented by the distance r from the origin O and two angular parameters θ and φ.
[0031] Here, the virtual object VO is assumed to be a doll, consisting of a head P1 and a torso P2. Furthermore, on display 14, a sub-object S containing the virtual object VO is displayed, centered on a point included within the virtual object VO. The sub-object S is a virtual and transparent object. Note that the shape of the sub-object S containing the virtual object VO is not limited to a sphere. For example, the sub-object S may be a cube, a cylinder, or other shape other than a sphere. In the example shown in Figure 3, the centroid of the virtual object VO is the origin O, and a transparent sub-object S centered on the origin O is superimposed on the virtual object VO. Note that the origin O being the centroid of the virtual object VO is merely an example. The origin O can be any point included within the virtual object VO. User U K The input device 25 operates to set at least one of the directions in which the virtual object VO can be viewed and the direction in which it cannot be viewed for the sub-object S. Specifically, user U KThe user U may operate the input device 25 to set the viewable direction as a vector that is orthogonal to the surface of the sub-object S and passes through the origin O, i.e., the normal vectors V1 to V3 to the surface of the sub-object S. Alternatively, the user U K The input device 25 may be operated to set vectors that are orthogonal to the surface of the sub-object S and pass through the origin O, i.e., normal vectors V1 to V3 to the surface of the sub-object S, as directions that cannot be viewed. In the example shown in Figure 3, the setting unit 114 sets these normal vectors, expressed using three-dimensional polar coordinates (r, θ, φ), as viewing information for the virtual object VO. The set viewing information is stored in the storage device 12, linked to image information representing the virtual object VO. Note that the normal vectors V1 to V3 are merely vectors that set the directions that can be viewed and the directions that cannot be viewed for the virtual object VO, so the value of "r" in the polar coordinates can be any value.
[0032] The terminal device 10-K can use the normal vector to the surface of the sub-object S to set viewing information that indicates at least one of the viewing directions and non-viewing directions of the virtual object VO. As a result, the terminal device 10-K can manage viewing information with the sub-object S as a single unit.
[0033] User U K The user U may set the browsing information based on the shape of part or all of the virtual object VO. Alternatively, user U K The browsing information may be set based on at least one of the surface condition of part or all of the virtual object VO, and the appearance of the surface.
[0034] Also, User U K In the information setting system 1 shown in Figure 1, viewing information for the virtual object VO may be set according to the attributes of viewers who view the virtual object VO using terminal devices 10-1 to 10-N. For example, user U KDepending on whether the viewer's attributes are those of an administrator of the information setting system 1, viewing information for the virtual object VO may be set. Alternatively, user U K The system may set viewing information for virtual objects VO based on the viewer's age, gender, or whether or not they belong to a specific organization. In these cases, for example, the display 14 will show as many virtual objects VO as there are types of attributes of the viewer. User U K This sets viewing information for each of the sub-objects S that are superimposed on each of the virtual objects VO, which are displayed according to the number of attribute types. The setting unit 114 sets the user U K Based on the operation on the input device 15, browsing information is set according to the attributes of the viewer who is viewing the virtual object VO.
[0035] As a result, the terminal device 10-K can switch viewing information indicating at least one of the viewing directions and viewing directions, for example, according to the viewer's age.
[0036] A virtual object VO after viewing information has been set may overwrite a virtual object VO before viewing information was set. Alternatively, a new virtual object VO may be created after viewing information has been set, and the virtual object VO before viewing information was set may be stored in the storage device 12 of terminal device 10-K. The virtual object VO after viewing information has been set is output to server 20, and then output from server 20 to terminal devices 10-1 to 10-N, including terminal device 10-J. The display control unit 113 in terminal devices 10-1 to 10-N causes the virtual object VO to be displayed on the display 14. When the virtual object VO is displayed on the display 14, the viewer can rotate the virtual object VO using, for example, an input device 15. However, the viewer cannot rotate the virtual object VO to a position where they can view it from a direction they cannot see.
[0037] Alternatively, if a virtual object VO is displayed in the virtual space on display 14, for example, an operation control unit (not shown) may execute a process in the virtual space that prevents the viewer from moving in a direction that is not viewable from the perspective of the virtual object VO. In this case, for example, an operation control unit (not shown) may execute a process in the virtual space that prevents the viewer from physically moving in a direction that is not viewable set for the virtual object VO. Alternatively, as described later, the appearance processing unit 115 may perform a process to conceal the appearance of a portion of the virtual object VO that is displayed when the viewer moves in a direction that is not viewable set for the virtual object VO in the virtual space.
[0038] As a result of the setting unit 114 setting the viewing information, the terminal device 10-K can restrict the viewing of the virtual object VO itself. In particular, the terminal device 10-K can, for example, make the bottom surface of the virtual object VO inaccessible. Furthermore, since the terminal device 10-K sets the viewing information on the virtual object VO itself, the cumbersome process of changing the viewer's field of view each time the virtual object VO rotates is eliminated.
[0039] Returning to the explanation in Figure 2, the appearance processing unit 115 hides the appearance of at least a portion of the region of the 3D virtual object VO that would be displayed when the 3D virtual object VO is viewed from a direction that is not accessible. The appearance processing unit 115 also generates processing information that shows the image of the hidden region after it has been hidden.
[0040] Figure 4 is an explanatory diagram illustrating an example of a processing method for the virtual object VO. The diagram of the virtual object VO shown in Figure 4 is a diagram of the virtual object VO as viewed from the direction of the normal vector V3 in Figure 3. In Figure 3, the normal vector V3 is assumed to indicate the direction in which the virtual object VO cannot be viewed.
[0041] User U KAssuming that the viewer views the virtual object VO from the direction of the normal vector V3, we do not want the viewer to see the bottom surface of the torso P2 of the virtual object VO. In this case, user U K The user U performs an operation to fill in the fuselage portion P2 of the virtual object VO shown on display 14 using the input device 15. As a result, the appearance processing unit 115 hides the area of the fuselage portion P2 of the virtual object VO when viewed from the direction of the normal vector V3. K The operation may involve filling in not only the area of the torso P2 but also the area of the head P1. In this case, the appearance processing unit 115 performs a process to hide the areas of both the head P1 and the torso P2 when viewed from the direction of the normal vector V3 in the appearance of the virtual object VO. The processing information showing the image after the above areas have been hidden is stored in the storage device 12 in association with the image information showing the virtual object VO.
[0042] As a result of the appearance processing unit 115 performing a process to conceal the appearance of the virtual object VO for at least a portion of its area, the terminal device 10-K can, for example, make the bottom surface of the virtual object VO inaccessible. Furthermore, the terminal device 10-K does not need to change the masked area in the viewer's field of view each time, depending on where in the viewer's field of view the area of the virtual object VO that it does not want the viewer to see is displayed.
[0043] Returning to the explanation in Figure 2, the output unit 116 outputs the browsing information and processing information stored in the storage device 12 to the server 20.
[0044] As described later, the server 20 generates a new virtual object VO based on image information acquired from terminal device 10-J and at least one of the browsing information and processing information acquired from terminal device 10-K. In terminal device 10-J, the acquisition unit 111 acquires image information indicating the new virtual object VO from the server 20.
[0045] In terminal device 10-J, rather than terminal device 10-K, the output unit 116 outputs image information indicating the virtual object VO generated by the generation unit 112 to the server 20.
[0046] 1-1-3: Server Configuration Figure 5 is a block diagram showing an example configuration of server 20. Server 20 comprises a processing unit 21, a storage device 22, a communication device 23, a display 24, and an input device 25. Each element of server 20 is interconnected using one or more buses for communicating information.
[0047] The processing unit 21 is a processor that controls the entire server 20. The processing unit 21 is configured using, for example, one or more chips. The processing unit 21 is configured using, for example, a central processing unit (CPU) that includes interfaces with peripheral devices, an arithmetic unit, and registers. Some or all of the functions of the processing unit 21 may be implemented using hardware such as a DSP, ASIC, PLD, and FPGA. The processing unit 21 executes various processes in parallel or sequentially.
[0048] The storage device 22 is a recording medium that can be read from and written to by the processing device 21. The storage device 22 also stores multiple programs, including the control program PR2 executed by the processing device 21.
[0049] The communication device 23 is hardware acting as a transmitting and receiving device for communicating with other devices. The communication device 23 is also called, for example, a network device, a network controller, a network card, and a communication module. The communication device 23 may be equipped with a connector for wired connection and an interface circuit corresponding to the connector. The communication device 23 may also be equipped with a wireless communication interface. Examples of connectors and interface circuits for wired connection include products compliant with wired LAN, IEEE1394, and USB. Examples of wireless communication interfaces include products compliant with wireless LAN and Bluetooth®.
[0050] The display 24 is a device that displays images and text information. The display 24 displays various images under the control of the processing unit 21. For example, various display panels such as liquid crystal display panels and organic EL display panels are preferably used as the display 24.
[0051] The input device 25 is a device that receives operations from the administrator of the information setting system 1. For example, the input device 25 is configured to include a keyboard, touchpad, touch panel, or pointing device such as a mouse. If the input device 25 is configured to include a touch panel, it may also function as the display 24.
[0052] The processing unit 21, for example, reads and executes the control program PR2 from the storage device 22. As a result, the processing unit 21 functions as an acquisition unit 211, a generation unit 212, and an output unit 213.
[0053] The acquisition unit 211 receives user U from terminal device 10-J via communication device 23. J Image information representing the virtual object VO generated by is acquired. The acquisition unit 211 also acquires browsing information and processing information from the terminal device 10-K via the communication device 23.
[0054] The generation unit 212 uses the image information acquired by the acquisition unit 211 from terminal device 10-J and at least one of the browsing information and processing information acquired from terminal device 10-K to generate information for user U JThe generation unit 212 generates a new virtual object VO that is different from the virtual object VO generated by the user U. For example, the generation unit 212 generates a new virtual object VO that has an appearance based on image information acquired from the terminal device 10-J, and in which at least one of the directions in which it can be viewed and the directions in which it cannot be viewed is set by the viewing information. Alternatively, the generation unit 212 generates a new virtual object VO in which at least a portion of the virtual object VO having an appearance based on image information acquired from the terminal device 10-J is obscured by the image indicated by the processing information. Alternatively, the generation unit 212 generates a temporary virtual object VO that has an appearance based on image information acquired from the terminal device 10-J, and in which at least one of the directions in which it can be viewed and the directions in which it cannot be viewed is set by the viewing information. The virtual object VO is used by user U. J User U K This is a virtual object VO that has at least one of the viewing information and processing information set.
[0055] The output unit 213 receives the user U information from the terminal device 10-J via the communication device 23. J The output unit 213 outputs image information showing the virtual object VO generated by the generation unit 212 to terminal devices 10-1 to 10-N, including terminal device 10-J, via the communication device 23.
[0056] Furthermore, as will be explained later, User U K User U J When processing information is set using terminal device 10-J, output unit 213 outputs viewing information to terminal device 10-J. In this case, acquisition unit 211 acquires processing information from terminal device 10-J via communication device 23.
[0057] 1-2: Operation of the First Embodiment 1-2-1: First action Figure 6 is a sequence diagram showing the first operation of the information setting system 1 according to the first embodiment. The first operation is the operation in which the terminal device 10-K sets both browsing information and processing information for the virtual object VO. The first operation of the information setting system 1 will be described below with reference to Figure 6.
[0058] In step S1, the processing unit 11 provided in the terminal device 10-J functions as a generation unit 112. The processing unit 11 is used by user U J Based on operation information indicating the content of the operation on the input device 15, a three-dimensional virtual object VO is generated to be displayed in the virtual space.
[0059] In step S2, the processing unit 11 in the terminal device 10-J functions as an output unit 116. The processing unit 11 outputs image information indicating the virtual object VO generated in step S1 to the server 20. The processing unit 21 in the server 20 functions as an acquisition unit 211. The processing unit 21 acquires image information indicating the virtual object VO generated by the terminal device 10-J from the terminal device 10-J.
[0060] In step S3, the processing unit 21 in the server 20 functions as an output unit 213. The processing unit 21 outputs image information indicating the virtual object VO generated by terminal device 10-J, which was acquired in step S2, to terminal device 10-K. In addition, the processing unit 11 in terminal device 10-K functions as an acquisition unit 111. The processing unit 11 acquires image information indicating the virtual object VO generated by terminal device 10-J from the server 20.
[0061] In step S4, the processing unit 11 in the terminal device 10-K functions as a display control unit 113. The processing unit 11 uses the image information acquired in step S3 to display the virtual object VO on the display 14.
[0062] In step S5, the processing unit 11 in the terminal device 10-K functions as a setting unit 114. The processing unit 11 sets viewing information for the virtual object VO indicated by the image information acquired in step S3, indicating at least one of the viewing directions and the viewing directions.
[0063] In step S6, the processing unit 11 in the terminal device 10-K functions as an output unit 116. The processing unit 11 outputs the browsing information set in step S5 to the server 20. The processing unit 21 in the server 20 functions as an acquisition unit 211. The processing unit 21 acquires the browsing information from the terminal device 10-K.
[0064] In step S7, the processing unit 11 in the terminal device 10-K functions as an appearance processing unit 115. The processing unit 11 hides at least a portion of the area of the virtual object VO that would be displayed if the virtual object VO were viewed from a direction that is not accessible. The processing unit 11 also generates processing information that shows the image of the hidden area after it has been hidden.
[0065] In step S8, the processing unit 11 in the terminal device 10-K functions as an output unit 116. The processing unit 11 outputs the processing information generated in step S7 to the server 20. The processing unit 21 in the server 20 functions as an acquisition unit 211. The processing unit 21 acquires the processing information from the terminal device 10-K.
[0066] In step S9, the processing unit 21 of the server 20 functions as a generation unit 212. The processing unit 21 uses the image information acquired in step S2, the browsing information acquired in step S6, and at least one of the processing information acquired in step S8 to generate a new virtual object VO that is different from the virtual object VO generated by the terminal device 10-J.
[0067] In step S10, the processing unit 21 in the server 20 functions as an output unit 213. The processing unit 21 outputs image information indicating the new virtual object VO generated by the generation unit 212 to terminal devices 10-1 to 10-N, including terminal device 10-J. The processing unit 11 in terminal device 10-J functions as an acquisition unit 111. The processing unit 11 acquires image information indicating the new virtual object VO from the server 20.
[0068] In step S11, the processing unit 11 in the terminal device 10-J functions as a display control unit 113. The processing unit 11 uses the image information acquired in step S10 to display a new virtual object VO on the display 14.
[0069] 1-2-2: Second action Figure 7 is a sequence diagram showing the second operation of the information setting system 1 according to the first embodiment. The second operation is in which terminal device 10-K sets browsing information for the virtual object VO, and terminal device 10-J sets processing information for the virtual object VO on which the browsing information has been set. The second operation of the information setting system 1 will be described below with reference to Figure 7.
[0070] In step S21, the processing unit 11 provided in the terminal device 10-J functions as a generation unit 112. The processing unit 11 is used by user U J Based on operation information indicating the content of the operation on the input device 15, a three-dimensional virtual object VO is generated to be displayed in the virtual space.
[0071] In step S22, the processing unit 11 in the terminal device 10-J functions as an output unit 116. The processing unit 11 outputs image information indicating the virtual object VO generated in step S21 to the server 20. The processing unit 21 in the server 20 functions as an acquisition unit 211. The processing unit 21 acquires image information indicating the virtual object VO generated by the terminal device 10-J from the terminal device 10-J.
[0072] In step S23, the processing unit 21 in the server 20 functions as an output unit 213. The processing unit 21 outputs image information indicating the virtual object VO generated by terminal device 10-J, which was acquired in step S22, to terminal device 10-K. The processing unit 11 in terminal device 10-K functions as an acquisition unit 111. The processing unit 11 acquires image information indicating the virtual object VO generated by terminal device 10-J from the server 20.
[0073] In step S24, the processing unit 11 in the terminal device 10-K functions as a display control unit 113. The processing unit 11 uses the image information acquired in step S23 to display the virtual object VO on the display 14.
[0074] In step S25, the processing unit 11 in the terminal device 10-K functions as a setting unit 114. The processing unit 11 sets viewing information for the virtual object VO indicated by the image information acquired in step S23, indicating at least one of the viewing directions and the viewing directions that are not accessible.
[0075] In step S26, the processing unit 11 in the terminal device 10-K functions as an output unit 116. The processing unit 11 outputs the browsing information set in step S25 to the server 20. The processing unit 21 in the server 20 functions as an acquisition unit 211. The processing unit 21 acquires the browsing information from the terminal device 10-K.
[0076] In step S27, the processing unit 21 in the server 20 functions as an output unit 213. The processing unit 21 outputs the browsing information acquired in step S26 to the terminal device 10-J. The processing unit 11 in the terminal device 10-J functions as an acquisition unit 111. The processing unit 11 acquires the browsing information from the server 20.
[0077] In step S28, the processing unit 11 in the terminal device 10-J functions as a display control unit 113. The processing unit 11 uses the image information representing the virtual object VO generated in step S21 and the browsing information acquired in step S27 to display the virtual object VO, for which the browsing information has been set, on the display 14.
[0078] In step S29, the processing unit 11 in the terminal device 10-J functions as an appearance processing unit 115. The processing unit 11 hides at least a portion of the area of the virtual object VO that would be displayed if the virtual object VO were viewed from a direction that is not accessible. The processing unit 11 also generates processing information that shows the image of the hidden area after it has been hidden.
[0079] In step S30, the processing unit 11 in the terminal device 10-J functions as an output unit 116. The processing unit 11 outputs the processing information generated in step S29 to the server 20. The processing unit 21 in the server 20 functions as an acquisition unit 211. The processing unit 21 acquires the processing information from the terminal device 10-J.
[0080] In step S31, the processing unit 21 of the server 20 functions as a generation unit 212. The processing unit 21 uses the image information acquired in step S22, the browsing information acquired in step S26, and at least one of the processing information acquired in step S30 to generate a new virtual object VO that is different from the virtual object VO generated by the terminal device 10-J.
[0081] In step S32, the processing unit 21 in the server 20 functions as an output unit 213. The processing unit 21 outputs image information indicating the new virtual object VO generated by the generation unit 212 to terminal devices 10-1 to 10-N, including terminal device 10-K.
[0082] In step S33, the processing unit 11 in the terminal device 10-K functions as a display control unit 113. The processing unit 11 uses the image information acquired in step S32 to display a new virtual object VO on the display 14.
[0083] 1-3: Effects of the First Embodiment According to the above description, the terminal device 10-K, as an information setting device, comprises an acquisition unit 111 and a setting unit 114. The acquisition unit 111 acquires a three-dimensional virtual object VO to be displayed in the virtual space. The setting unit 114 sets viewing information for the three-dimensional virtual object VO, indicating at least one of the directions in which it can be viewed and directions in which it cannot be viewed.
[0084] Since terminal device 10-K has the above configuration, it can restrict the viewability of the virtual object VO itself. In particular, terminal device 10-K can, for example, make the bottom surface of the virtual object VO inaccessible. Furthermore, in methods that restrict the viewer's field of view, when the virtual object VO rotates, areas of the virtual object VO that are not to be seen by the viewer may enter the viewer's field of view. Terminal device 10-K sets viewing information on the virtual object VO itself, unlike simply blocking the viewer's field of view, so that even when the virtual object VO rotates in the virtual space, the viewer cannot view the virtual object VO from the direction that is not to be seen. Also, in methods that restrict the viewer's field of view, it was necessary to change the mask area in the viewer's field of view each time, depending on where in the viewer's field of view the areas of the virtual object VO that are not to be seen by the viewer are displayed. However, since terminal device 10-K sets viewing information on the virtual object VO itself, the cumbersome process of changing the viewer's field of view each time in accordance with the rotation of the virtual object VO is eliminated.
[0085] Furthermore, according to the above explanation, in the terminal device 10-K, the setting unit 114 sets the above-mentioned browsing information to the object S which contains the three-dimensional virtual object VO.
[0086] Since the terminal device 10-K has the above configuration, it can utilize the normal vector to the surface of object S when setting viewing information for the virtual object VO itself, indicating at least one of the directions in which it can be viewed and directions in which it cannot be viewed. As a result, the terminal device 10-K can manage viewing information with object S as a single unit.
[0087] Furthermore, according to the above description, the terminal device 10-K further comprises an appearance processing unit 115. Based on the above viewing information, the appearance processing unit 115 performs a process to conceal the appearance of the 3D virtual object VO for at least a portion of the area of the 3D virtual object VO that would be displayed if the 3D virtual object VO were viewed from a direction that is not accessible.
[0088] Since terminal device 10-K has the above configuration, when restricting the viewing of a 3D virtual object VO, it is not necessary to change the area of the mask in the viewer's field of view each time, depending on where in the viewer's field of view areas of the virtual object VO that are not to be shown to the viewer are displayed.
[0089] Furthermore, according to the above explanation, in the terminal device 10-K, the setting unit 114 sets the above-mentioned viewing information according to the attributes of the viewer who is viewing the three-dimensional virtual object VO.
[0090] Since the terminal device 10-K has the above configuration, it can switch viewing information indicating at least one of the viewing directions and viewing directions that cannot be viewed, for example, depending on the viewer's age. For example, the terminal device 10-K can increase the number of viewing directions that cannot be viewed when the viewer is relatively young, while decreasing the number of viewing directions that cannot be viewed when the viewer is relatively old.
[0091] 2: Second Embodiment Hereinafter, with reference to Figures 8 and 9, the configuration of the information setting system 1A, which includes a terminal device 10A-K as an information setting device according to the second embodiment of the present invention, will be described. In the following description, for the purpose of simplifying the explanation, the same reference numerals will be used for components of the information setting system 1A according to the second embodiment that are the same as those of the information setting system 1 according to the first embodiment, and their descriptions may be omitted.
[0092] 2-1: Configuration of the second embodiment 2-1-1: Overall Structure The information setting system 1A according to the second embodiment of the present invention differs from the information setting system 1 according to the first embodiment in that it includes a terminal device 10A-K instead of a terminal device 10-K. In all other respects, the overall configuration of the information setting system 1A is the same as the overall configuration of the information setting system 1 according to the first embodiment shown in Figure 1, so its illustration and description are omitted.
[0093] 2-1-2: Terminal device configuration Unlike terminal device 10-K, terminal device 10A-K includes a processing unit 11A instead of processing unit 11, and a storage device 12A instead of storage device 12. Processing unit 11A includes a setting unit 114A instead of the setting unit 114 provided in processing unit 11, and an appearance processing unit 115A instead of the appearance processing unit 115. Furthermore, storage device 12A stores control program PR1A instead of the control program PR1 stored in storage device 12. In all other respects, the configuration of terminal device 10A-K is the same as the configuration of terminal device 10-K according to the first embodiment shown in Figure 2, so its illustration and description are omitted.
[0094] The setting unit 114A sets viewing information indicating whether or not viewing is permitted for each of the multiple regions that constitute the surface of the three-dimensional virtual object VO.
[0095] Figure 8 is an explanatory diagram showing an example of how to set browsing information. Display 14 shows User U JA three-dimensional virtual object VO generated using terminal device 10-J is displayed. In the virtual object VO displayed on display 14, the surface of the virtual object VO is divided into regions A1 to A10. More specifically, the surface of the head P1 included in the virtual object VO is divided into A1 to A4. In addition, the surface of the torso P2 included in the virtual object VO is divided into A5 to A10.
[0096] User U K The user U operates the input device 25 to set whether or not each of areas A1 to A10 can be viewed. Specifically, user U K The user U operates the input device 25 and selects one of the regions A1 to A10. K The system operates the input device 25 to set access information for the specified area, indicating whether it should be accessible or inaccessible.
[0097] In the example shown in Figure 8, the surface of the virtual object VO is divided into regions A1 to A10. The division of the surface of the virtual object VO may be performed automatically by the processing unit 11A or the server 20. Alternatively, user U J or User U K The input device 25 may be operated to manually divide the surface of the virtual object VO.
[0098] The appearance processing unit 115A performs a process to delete at least the areas that the setting unit 114 has set as inaccessible from the three-dimensional virtual object VO. The appearance processing unit 115A also generates processing information indicating the areas to be deleted.
[0099] Figure 9 is an explanatory diagram illustrating an example of a processing method for a virtual object VO. Here, in Figure 8, the setting unit 114A is set to allow viewing of regions A1, A3, A5, A7, and A9 among the multiple regions that constitute the surface of the virtual object VO. On the other hand, the setting unit 114A is set to not allow viewing of regions A2, A4, A6, A8, and A10 among the multiple regions that constitute the surface of the virtual object VO.
[0100] As shown in Figure 9, the appearance processing unit 115A deletes at least regions A2, A4, A6, A8, and A10 from the virtual object VO.
[0101] More specifically, if the appearance processing unit 115A divides the three-dimensional virtual object VO into multiple solids along the boundary lines of regions A1 to A10, it may delete the solids containing regions A2, A4, A6, A8, and A10 from the virtual object VO.
[0102] Alternatively, the appearance processing unit 115A may remove all other parts from the three-dimensional virtual object VO, leaving only the outer shell of a predetermined thickness with regions A1, A3, A5, A7, and A10 as surfaces.
[0103] As a result of the appearance processing unit 115A deleting at least the areas that are set to be inaccessible from the virtual object VO, the amount of data in the virtual object VO after deleting the inaccessible areas is reduced. Consequently, when the server 20 distributes the virtual object VO to terminal devices 10-1 to 10-N, the processing load is reduced.
[0104] 2-2: Operation of the second embodiment 2-2-1: First action The first operation of the information setting system 1A according to the second embodiment is basically the same as the first operation of the information setting system 1 according to the first embodiment shown in Figure 6, so its illustration and detailed explanation are omitted.
[0105] In the first operation of the information setting system 1A, in step S5 of the sequence diagram shown in Figure 6, the processing unit 11 sets viewing information indicating whether or not viewing is permitted for each of the multiple regions constituting the surface of the virtual object VO, which is different from the first operation of the information setting system 1 according to the first embodiment.
[0106] Furthermore, the first operation of the information setting system 1A differs from the first operation of the information setting system 1 according to the first embodiment in that, in step S7 of the sequence diagram shown in Figure 6, the processing unit 11 performs a process to delete at least the area set to be inaccessible from the virtual object VO.
[0107] 2-2-2: Second Action The second operation of the information setting system 1A according to the second embodiment is basically the same as the second operation of the information setting system 1 according to the first embodiment shown in Figure 7, so its illustration and detailed explanation are omitted.
[0108] In the second operation of the information setting system 1A, in step S25 of the sequence diagram shown in Figure 7, the processing unit 11 sets viewing information indicating whether or not viewing is permitted for each of the multiple regions constituting the surface of the virtual object VO, which differs from the first operation of the information setting system 1 according to the first embodiment.
[0109] Furthermore, the second operation of the information setting system 1A differs from the first operation of the information setting system 1 according to the first embodiment in that, in step S29 of the sequence diagram shown in Figure 7, the processing unit 11 performs a process to delete at least the area set to be inaccessible from the virtual object VO.
[0110] 2-3: Effects of the second embodiment According to the above description, the terminal device 10A-K, which serves as an information setting device, comprises an acquisition unit 111 and a setting unit 114A. The acquisition unit 111 acquires a three-dimensional virtual object VO to be displayed in the virtual space. The setting unit 114A sets viewing information indicating whether or not viewing is permitted for each of the multiple regions that constitute the surface of the three-dimensional virtual object VO.
[0111] Since terminal device 10A-K has the above configuration, it can restrict the viewability of the virtual object VO itself. In particular, in methods that restrict the viewer's field of view, when the virtual object VO rotates, areas of the virtual object VO that are not to be seen by the viewer may enter the viewer's field of view. Terminal device 10A-K sets viewing information on the virtual object VO itself, unlike simply blocking the viewer's field of view, so that even when the virtual object VO rotates in the virtual space, the viewer cannot view areas that are not to be seen. Furthermore, in methods that restrict the viewer's field of view, it was necessary to change the masked area in the viewer's field of view each time, depending on where in the viewer's field of view the areas of the virtual object VO that are not to be seen by the viewer are displayed. However, since terminal device 10A-K sets viewing information on the virtual object VO itself, the cumbersome process of changing the viewer's field of view each time in accordance with the rotation of the virtual object VO is unnecessary.
[0112] Furthermore, according to the above description, the terminal device 10A-K further comprises an appearance processing unit 115A. The appearance processing unit 115A performs a process to remove at least the areas that are set to be inaccessible from the three-dimensional virtual object VO.
[0113] Since terminal devices 10A-K have the above configuration, the amount of data in the virtual object VO after deleting the area set as inaccessible is reduced. As a result, the processing load is reduced when server 20 distributes the virtual object VO to terminal devices 10-1 to 10-N.
[0114] 3: Third Embodiment The configuration of the information setting system 1B, including the server 20A as an information setting device according to the third embodiment of the present invention, will be described below with reference to Figures 10 to 14. In the following description, for the purpose of simplifying the explanation, the same reference numerals will be used for components of the information setting system 1B according to the third embodiment that are the same as those of the information setting system 1 according to the first embodiment, and their descriptions may be omitted.
[0115] In the information setting system 1 according to the first embodiment and the information setting system 1A according to the second embodiment, the terminal device 10-K set the browsing information. On the other hand, in the information setting system 1B according to the third embodiment, the server 20A sets the browsing information.
[0116] 3-1: Configuration of the third embodiment 3-1-1: Overall Structure The information setting system 1B according to the third embodiment of the present invention differs from the information setting system 1 according to the first embodiment in that it includes a server 20A instead of a server 20. In all other respects, the overall configuration of the information setting system 1B is the same as the overall configuration of the information setting system 1 according to the first embodiment shown in Figure 1, so its illustration and description are omitted. In this embodiment, the server 20A is an example of an information setting device.
[0117] 3-1-2: Server Configuration Figure 10 is a block diagram showing an example configuration of server 20A. Unlike server 20, server 20A is equipped with a processing unit 21A instead of processing unit 21, and a storage device 22A instead of storage device 22.
[0118] The storage device 22A stores control program PR2A instead of control program PR2 stored in storage device 22. In addition to the components stored in storage device 22, storage device 22A also stores the display-prohibited image database ND, the browsing information database VD, and the learning model LM.
[0119] The display-prohibited image database ND is a database that stores image information indicating three-dimensional virtual objects that are prohibited from being output by server 20A to terminal devices 10-1 to 10-N. In other words, in the virtual space displayed on the displays 14 of terminal devices 10-1 to 10-N, three-dimensional virtual objects indicated by the image information stored in the display-prohibited image database ND are prohibited from being displayed. Virtual objects that are prohibited from being displayed in the virtual space are called display-prohibited objects.
[0120] Figure 11 is a table showing an example of the configuration of the display-prohibited image database ND. The display-prohibited image database ND stores filenames that indicate image information for display-prohibited object NOs. The image information for display-prohibited object NOs themselves is stored in storage device 22A. In addition, for each file in the display-prohibited image database ND, a pair of filenames indicating the image information of the 3D image for each of the multiple regions that constitute the surface of the display-prohibited object NO and the display position of the said 3D image are stored. For example, in the example shown in Figure 11, the surface of the display-prohibited object NO indicated by the filename "AAA.vrml" consists of a 3D image indicated as "Region 1", a 3D image indicated as "Region 2", ... and a 3D image indicated as "Region m". "Region 1" is indicated by the file "A1.vrml". "Region 2" is indicated by the filename "A2.vrml". "Region m" is indicated by the filename "Am.vrml". Here, m is an integer of 2 or more. As an example, the display position of the said 3D image is specified using 3D polar coordinates. For example, in the example shown in Figure 11, the 3D image of "Region 1," indicated by the file name "A1.vrml," has its centroid (r,φ,θ)=(r a1 ,φ a1 ,θ a1 It is displayed at the coordinates of ). However, the display position of the 3D image may be specified using a coordinate system other than 3D polar coordinates, for example, a 3D Cartesian coordinate system.
[0121] Returning to the explanation in Figure 10, the browsing information database VD is a database that defines which of the multiple regions constituting the surface of the display-prohibited object NO corresponds to which region of the surface of the virtual object VO should be made unavailable for viewing, based on the similarity between the virtual object VO and the display-prohibited object NO. The "similarity" is calculated by the calculation unit 214 described later.
[0122] Figure 12 is a table showing an example of the configuration of the browsing information database VD. The browsing information database VD stores pairs of filenames and similarity scores that represent image information of prohibited object NOs. Furthermore, for each pair, it is defined which of the files representing the image information of multiple areas contained in the surface of the prohibited object NO will make the corresponding areas on the surface of the virtual object VO inaccessible. For example, if the similarity between the virtual object VO and the prohibited object NO represented by the filename "AAA.vrml" is 70%, then the areas on the surface of the virtual object VO corresponding to the inaccessible areas represented by the filenames "A1.vrml" and "A2.vrml" will become inaccessible. Here, the value "70%" is merely an example, and the similarity threshold can be set to any value. Specifically, for example, if both the prohibited object number and the virtual object VO represent the entire figure of the doll, and the image information indicated by the file name "A1.vrml" is, for example, an image showing the head of the doll as the prohibited object number, then the doll's head indicated by the virtual object VO will be made inaccessible. Similarly, if the image information indicated by the file name "A2.vrml" is, for example, an image showing the right arm of the doll as the prohibited object number, then the doll's right arm indicated by the virtual object VO will be made inaccessible.
[0123] Returning to the explanation in Figure 10, the learning model LM is a learning model used when the setting unit 215, described later, refers to the above-mentioned browsing information database VD to set browsing information for the virtual object VO. For example, if the similarity between the virtual object VO and the display-prohibited object NO indicated by the file name "AAA.vrml" is 70%, the setting unit 215 refers to the browsing information database VD and makes the areas of the virtual object VO that correspond to the unviewable areas indicated by the file names "A1.vrml" and "A2.vrml" among the multiple areas that constitute the surface of the display-prohibited object NO unviewable. More specifically, the setting unit 215 inputs image information showing the overall image of the virtual object VO and the image information indicated by the file name "A1.vrml" into the learning model LM. As a result, the learning model LM outputs image information for the area corresponding to the area indicated by the file name "A1.vrml" among the multiple areas that constitute the surface of the virtual object VO. The same applies to the area indicated by the file name "A2.vrml". Following the example above, when the setting unit 215 inputs image information showing the overall view of the doll as a virtual object VO and image information showing the doll's head as a display-prohibited object NO to the learning model LM, the learning model LM outputs the image information showing the doll's head as a virtual object VO. Similarly, when the setting unit 215 inputs image information showing the overall view of the doll as a virtual object VO and image information showing the doll's right arm as a display-prohibited object NO to the learning model LM, the learning model LM outputs the image information showing the doll's right arm as a virtual object VO. Subsequently, the setting unit 215 sets viewing information indicating that the two regions constituting the surface of the virtual object VO output from the learning model LM are not viewable.
[0124] The learning model LM is generated during the learning phase by learning from training data. The training data used to generate the learning model LM consists of multiple sets of (a1) image information of a virtual object VO and (a2) image information of each region contained in the display-prohibited object NO, and (b) image information indicating the region within the virtual object VO corresponding to each of those regions.
[0125] Furthermore, the learning model LM is generated outside of server 20A. In particular, it is preferable that the learning model LM be generated on a second server (not shown). In this case, server 20A obtains the learning model LM from the second server (not shown) via the communication network NET.
[0126] In addition to the components provided in the processing unit 21, the processing unit 21A further includes a calculation unit 214, a setting unit 215, and an appearance processing unit 216.
[0127] The calculation unit 214 calculates the similarity between the display-prohibited object NO and the virtual object VO. For example, the calculation unit 214 extracts multiple feature points from both the display-prohibited object NO stored in the display-prohibited image database ND and the virtual object VO, and calculates the similarity based on the degree to which the feature points of both match.
[0128] The setting unit 215 sets the viewing information based on the similarity calculated by the calculation unit 214. The viewing information here refers to viewing information indicating whether each of the multiple regions constituting the surface of the 3D virtual object VO can be viewed. More specifically, the setting unit 215 uses the file name of the object NO to be prohibited from display, for which the similarity was calculated by the calculation unit 214, and the said similarity to refer to the viewing information database VD and extract the regions that cannot be viewed. Furthermore, the setting unit 215 inputs the image information file representing the virtual object VO and the image information indicating the regions that cannot be viewed extracted from the viewing information database VD into the learning model LM, and causes it to output the regions constituting the surface of the virtual object VO that correspond to the extracted regions that cannot be viewed. Furthermore, the setting unit 215 sets viewing information indicating that the regions output from the learning model LM cannot be viewed.
[0129] The setting unit 215 sets the browsing information based on the similarity calculated by the calculation unit 214, so that when setting the browsing information for the virtual object VO itself, the server 20A can automatically set the browsing information. In other words, when setting the browsing information, the user U of terminal device 10-K K This operation will no longer be mandatory.
[0130] The appearance processing unit 216 performs a process to delete at least the areas that are set to be inaccessible from the virtual object VO. The appearance processing unit 216 also generates processing information indicating the areas to be deleted.
[0131] 3-2: Operation of the third embodiment 3-2-1: First Action Figure 13 is a sequence diagram showing the first operation of the information setting system 1B according to the third embodiment. The first operation is in which the server 20A sets both browsing information and processing information for the virtual object VO. The first operation of the information setting system 1 will be described below with reference to Figure 13.
[0132] In step S41, the processing unit 11 provided in the terminal device 10-J functions as a generation unit 112. The processing unit 11 is used by user UJ Based on operation information indicating the content of the operation on the input device 15, a three-dimensional virtual object VO is generated to be displayed in the virtual space.
[0133] In step S42, the processing unit 11 in the terminal device 10-J functions as an output unit 116. The processing unit 11 outputs image information indicating the virtual object VO generated in step S41 to the server 20A. The processing unit 21A in the server 20A functions as an acquisition unit 211. The processing unit 21A acquires image information indicating the virtual object VO generated by the terminal device 10-J from the terminal device 10-J.
[0134] In step S43, the processing unit 21A provided in the server 20A functions as a calculation unit 214. The processing unit 21A calculates the similarity between the display-prohibited object NO, which is a virtual object whose display in the virtual space is prohibited, and the three-dimensional virtual object VO, which is indicated by the image information acquired in step S42.
[0135] In step S44, the processing unit 21A provided in the server 20A functions as a setting unit 215. Based on the similarity calculated in step S42, the processing unit 21A sets browsing information for the virtual object VO.
[0136] In step S45, the processing unit 21A in the server 20A functions as an appearance processing unit 216. The processing unit 21A performs a process to delete at least the areas that are set to be inaccessible from the virtual object VO. The processing unit 21A also generates processing information indicating the areas to be deleted.
[0137] In step S46, the processing unit 21A in the server 20A functions as an output unit 213. The processing unit 21A outputs image information showing the virtual object VO after processing in step S45 to terminal devices 10-1 to 10-N, including terminal device 10-J. The processing unit 11 in terminal device 10-J functions as an acquisition unit 111. The processing unit 11 acquires image information from the server 20A.
[0138] In step S48, the processing unit 11 in the terminal device 10-J functions as a display control unit 113. The processing unit 11 uses the image information acquired in step S46 to display a new virtual object VO on the display 14.
[0139] 3-2-2: Second Action Figure 14 is a sequence diagram showing the second operation of the information setting system 1B according to the third embodiment. The second operation is in which the server 20A sets browsing information for the virtual object VO, and the terminal device 10-J sets processing information for the virtual object VO on which the browsing information has been set. The second operation of the information setting system 1 will be described below with reference to Figure 14.
[0140] In step S51, the processing unit 11 provided in the terminal device 10-J functions as a generation unit 112. The processing unit 11 is used by user U J Based on operation information indicating the content of the operation on the input device 15, a three-dimensional virtual object VO is generated to be displayed in the virtual space.
[0141] In step S52, the processing unit 11 in the terminal device 10-J functions as an output unit 116. The processing unit 11 outputs image information indicating the virtual object VO generated in step S51 to the server 20A. The processing unit 21A in the server 20A functions as an acquisition unit 211. The processing unit 21A acquires image information indicating the virtual object VO generated by the terminal device 10-J from the terminal device 10-J.
[0142] In step S53, the processing unit 21A provided in the server 20A functions as a calculation unit 214. The processing unit 21A calculates the similarity between the display-prohibited object NO, which is a virtual object whose display in the virtual space is prohibited, and the three-dimensional virtual object VO, which is indicated by the image information acquired in step S52.
[0143] In step S54, the processing unit 21A provided in the server 20A functions as a setting unit 215. Based on the similarity calculated in step S42, the processing unit 21A sets browsing information for the virtual object VO.
[0144] In step S55, the processing unit 21A in the server 20A functions as an output unit 213. The processing unit 21A outputs the browsing information set in step S54 to the terminal device 10-J. The processing unit 11 in the terminal device 10-J functions as an acquisition unit 111. The processing unit 11 acquires the browsing information from the server 20A.
[0145] In step S56, the processing unit 11 in the terminal device 10-J functions as a display control unit 113. The processing unit 11 uses the image information representing the virtual object VO generated in step S51 and the browsing information acquired in step S55 to display the virtual object VO, for which the browsing information has been set, on the display 14.
[0146] In step S57, the processing unit 11 in the terminal device 10-J functions as an appearance processing unit 115. The processing unit 11 deletes at least the area that has been set to be inaccessible from the virtual object VO. The processing unit 21A also generates processing information indicating the area to be deleted.
[0147] In step S58, the processing unit 11 in the terminal device 10-J functions as an output unit 116. The processing unit 11 outputs processing information indicating the area to be deleted in step S57 to the server 20A. The processing unit 21 in the server 20A functions as an acquisition unit 211. The processing unit 21A acquires the processing information from the terminal device 10-J.
[0148] In step S59, the processing unit 21A provided in the server 20A functions as a generation unit 212. The processing unit 21A uses the image information acquired in step S52, the browsing information set in step S54, and the processing information acquired in step S58 to generate a new virtual object VO that is different from the virtual object VO generated by the terminal device 10-J.
[0149] Subsequently, the processing unit 21 in the server 20 functions as an output unit 213. The processing unit 21 outputs image information indicating the new virtual object VO generated by the generation unit 212 to terminal devices 10-1 to 10-N.
[0150] 3-3: Effects of the third embodiment According to the above description, the server 20A, as an information setting device, comprises an acquisition unit 211 and a setting unit 215. The acquisition unit 211 acquires a three-dimensional virtual object VO to be displayed in the virtual space. The setting unit 215 sets viewing information indicating whether or not viewing is permitted for each of the multiple regions that constitute the surface of the three-dimensional virtual object VO.
[0151] Since Server 20A has the above configuration, it can restrict the viewability of the virtual object VO itself. In particular, in methods that restrict the viewer's field of view, when the virtual object VO rotates, areas of the virtual object VO that are not to be seen by the viewer may enter the viewer's field of view. Server 20A sets viewing information on the virtual object VO itself, so unlike simply blocking the viewer's field of view, even when the virtual object VO rotates in the virtual space, the viewer cannot view the virtual object VO from directions that are not allowed to be seen. Furthermore, in methods that restrict the viewer's field of view, it was necessary to change the masked area in the viewer's field of view each time, depending on where the areas of the virtual object VO that are not to be seen by the viewer are displayed in the viewer's field of view. However, since Server 20A sets viewing information on the virtual object VO itself, the cumbersome process of changing the viewer's field of view each time in accordance with the rotation of the virtual object VO is unnecessary.
[0152] Furthermore, according to the above explanation, server 20A also includes a calculation unit 214. The calculation unit 214 calculates the similarity between the display-prohibited object NO, which is a virtual object whose display in the virtual space is prohibited, and the three-dimensional virtual object VO acquired by the acquisition unit 211. The setting unit 215 sets the above-mentioned viewing information based on the above-mentioned similarity.
[0153] Since server 20A has the above configuration, when setting browsing information for the virtual object VO itself, server 20A can automatically set the browsing information. That is, when setting browsing information, user U of terminal device 10-K K This operation will no longer be mandatory.
[0154] 4: Variant This disclosure is not limited to the embodiments illustrated above. Specific variations are illustrated below. Two or more embodiments may be arbitrarily selected from the following examples.
[0155] 4-1: Torture 1 In the first operation of the information setting system 1 according to the first embodiment, the server 20 acquires browsing information and processing information from the terminal device 10-K and uses these to generate a new virtual object VO. However, the terminal device 10-K may generate the new virtual object VO instead of the server 20 and output image information representing the virtual object VO to the server 20. Similarly, in the second operation of the information setting system 1, the server 20 acquires browsing information from the terminal device 10-K and processing information from the terminal device 10-J and uses these to generate a new virtual object VO. However, the terminal device 10-J may generate the new virtual object VO instead of the server 20 and output image information representing the virtual object VO to the server 20. The same applies to the information setting system 1A according to the second embodiment.
[0156] 4-2: Variation 2 In the first and second operations of the information setting system 1B according to the third embodiment, the setting unit 215, also provided in the server 20A, sets the browsing information according to the similarity calculated by the calculation unit 214 provided in the server 20A. However, if the similarity calculated by the calculation unit 214 is equal to or greater than a threshold, the server 20A may output image information indicating the virtual object VO to the terminal device 10-K, and the terminal device 10-K may set the browsing information in the same manner as the information setting system 1 according to the first embodiment. In other words, user U K The user may use terminal device 10-K to set the browsing information.
[0157] 4-3: Modification 3 In the information setting system 1B according to the third embodiment, the server 20A stores the display-prohibited image database ND, the browsing information database VD, and the learning model LM, and also includes a calculation unit 214. In the information setting system 1 according to the first embodiment and the information setting system 1A according to the second embodiment, the terminal device 10-K may have the same components as those. That is, in the information setting system 1 according to the first embodiment and the information setting system 1A according to the second embodiment, the terminal device 10-K may calculate the similarity between the virtual object VO and the display-prohibited object NO, and set the browsing information according to the calculated similarity.
[0158] 4-4: Variation 4 In the information setting system 1 according to the first embodiment, the setting unit 114 sets viewing information for the object S containing the three-dimensional virtual object VO, indicating at least one of the directions in which viewing is possible and directions in which viewing is not possible. On the other hand, in the information setting system 1A according to the second embodiment, the setting unit 114A sets viewing information indicating whether or not viewing is possible for each of the multiple regions constituting the surface of the virtual object VO. However, the setting unit 114 or 114A may set viewing information indicating at least one of the directions in which viewing is possible and directions in which viewing is not possible for each of the multiple regions constituting the surface of the object S centered on a point included in the three-dimensional virtual object VO. That is, the setting unit 114 or 114A may use a normal vector passing through each of the multiple regions constituting the surface of the object S to set viewing information indicating at least one of the directions in which viewing is possible and directions in which viewing is not possible for each region.
[0159] 4-5: Variation 5 In the information setting system 1B according to the third embodiment, the setting unit 215 uses a learning model LM and refers to the browsing information database VD to set browsing information for the virtual object VO. However, the method for setting browsing information for the virtual object VO is not limited to this.
[0160] For example, the browsing information database VD may store terms indicating the names of the multiple regions constituting the surface of the object NO that is prohibited from display, instead of image information of the multiple regions included in the surface of the object NO that is prohibited from display. In this case, the setting unit 215 refers to the browsing information database VD and makes the regions of the virtual object VO that correspond to the unviewable regions indicated by terms such as "head" and "right arm" among the multiple regions constituting the surface of the object NO that is prohibited from display. More specifically, the setting unit 215 inputs image information showing the overall image of the virtual object VO and the term "head" into the learning model LM. As a result, the learning model LM outputs image information of the region corresponding to "head" among the multiple regions constituting the surface of the virtual object VO. The same applies to "right arm". Subsequently, the setting unit sets browsing information indicating that the two regions, "head" and "right arm," among the multiple regions constituting the surface of the virtual object VO are unviewable.
[0161] Alternatively, the setting unit 215 may perform pattern recognition on images that are not viewable in a two-dimensional image that is displayed assuming that a three-dimensional virtual object VO is displayed on the display 14 of the terminal device 10. Subsequently, the setting unit 215 detects the area of the image in question in the two-dimensional image and sets viewing information indicating that the area of the image is not viewable.
[0162] Alternatively, the acquisition unit 211 on the server 20A may acquire text information from the terminal device 10-K indicating an area that should not be viewable, and the setting unit 215 may use a learning model LM to identify the area corresponding to the text information in the three-dimensional virtual object VO. Subsequently, the setting unit 215 sets viewing information indicating that the area is not viewable.
[0163] Alternatively, the setting unit 215 may, for example, use a learning model LM to determine what is depicted in the virtual object VO, and if an object that is not viewable is depicted, it may identify the region in the virtual object VO in which that object is depicted. Subsequently, the setting unit 215 sets viewing information indicating that the region is not viewable. For example, the setting unit 215 may, after using a learning model LM to recognize that a cat is depicted in the 3D virtual object VO, set viewing information indicating that the region containing the cat is not viewable.
[0164] Alternatively, when generating a 3D virtual object VO in terminal device 10-J, user U J Based on the input, or automatically, one or more tags may be attached to the virtual object VO indicating what the virtual object VO represents and each of the regions contained within the virtual object VO. In this case, the setting unit 215 may set viewing information based on the tags indicating that the virtual object VO itself, or one or more regions contained within the virtual object VO, are not viewable.
[0165] 5: Other (1) In the embodiments described above, the storage devices 12 and 12A, and the storage devices 22 and 22A are exemplified by ROM and RAM, but can also be flexible disks, magneto-optical disks (e.g., compact disks, digital multipurpose disks, Blu-ray® disks), smart cards, flash memory devices (e.g., cards, sticks, key drives), CD-ROMs (Compact Disc-ROMs), registers, removable disks, hard disks, floppy® disks, magnetic strips, databases, servers, and other suitable storage media. The program may also be transmitted from a network via a telecommunications line. The program may also be transmitted from a communication network NET via a telecommunications line.
[0166] (2) In the embodiments described above, the information, signals, etc. may be represented using any of the various different techniques. For example, the data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be mentioned throughout the above description may be represented by voltage, current, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.
[0167] (3) In the embodiments described above, the input and output information may be stored in a specific location (e.g., memory) or managed using a management table. The input and output information may be overwritten, updated, or appended to. The output information may be deleted. The input information may be transmitted to other devices.
[0168] (4) In the embodiments described above, the determination may be made by a value represented using 1 bit (0 or 1), by a boolean value (true or false), or by a numerical comparison (for example, a comparison with a predetermined value).
[0169] (5) The processing procedures, sequences, flowcharts, etc., exemplified in the embodiments described above may be rearranged in order, as long as they do not contradict each other. For example, the methods described in this disclosure present various step elements using an exemplary order and are not limited to the specific order presented.
[0170] (6) Each function illustrated in Figures 1 to 14 is implemented by any combination of at least one of hardware and software. Furthermore, the method of implementing each functional block is not particularly limited. That is, each functional block may be implemented using one device that is physically or logically coupled, or it may be implemented using two or more physically or logically separated devices that are directly or indirectly connected (for example, using wired or wireless connections). A functional block may also be implemented by combining the above one device or the above multiple devices with software.
[0171] (7) The programs illustrated in the embodiments described above should be broadly interpreted to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, functions, etc., whether they are called software, firmware, middleware, microcode, hardware description languages or by other names.
[0172] Furthermore, software, instructions, information, etc., may be transmitted and received via a transmission medium. For example, if software is transmitted from a website, server, or other remote source using at least one of wired technology (such as coaxial cable, fiber optic cable, twisted pair, or digital subscriber line (DSL)) and wireless technology (such as infrared or microwave), then at least one of these wired and wireless technologies is included in the definition of a transmission medium.
[0173] (8) In each of the above-mentioned forms, the terms “system” and “network” shall be used interchangeably.
[0174] (9) The information, parameters, etc. described in this disclosure may be expressed using absolute values, relative values from a given value, or other corresponding information.
[0175] (10) In the embodiments described above, terminal devices 10-1 to 10-N, 10A-J, and 10A-K, and servers 20 and 20A, may be mobile stations (MS). A mobile station may also be referred to by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or several other appropriate terms. In this disclosure, terms such as “mobile station,” “user terminal,” “user equipment (UE),” and “terminal” may be used interchangeably.
[0176] (11) In the embodiments described above, the terms “connected,” “coupled,” or any variation thereof means any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are “connected” or “coupled” with each other. The coupling or connection between elements may be a physical coupling or connection, a logical coupling or connection, or a combination thereof. For example, “connection” may be reinterpreted as “access.” As used in this disclosure, two elements are considered to be “connected” or “coupled” with each other using at least one of one or more wires, cables and printed electrical connections, and, in some non-limiting and non-exclusive examples, electromagnetic energy having wavelengths in the radio frequency domain, microwave domain and optical (both visible and invisible) domain.
[0177] (12) In the embodiments described above, the phrase “based on” does not mean “based solely on” unless otherwise specified. In other words, the phrase “based on” means both “based solely on” and “based at least on.”
[0178] (13) The terms “determining” and “determining” as used in this disclosure may encompass a wide variety of actions. “Determining” may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiry (e.g., searching in a table, database or other data structure), and ascertaining. “Determining” may also include, for example, receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, and accessing (e.g., accessing data in memory). Furthermore, "judgment" and "decision" can include considering something as having been "judged" or "decided" after resolving, selecting, choosing, establishing, comparing, etc. In other words, "judgment" and "decision" can include considering something as having been "judged" or "decided" after some action. Also, "judgment (decision)" can be reinterpreted as "assuming," "expecting," "considering," etc.
[0179] (14) Where the terms “include,” “including,” and variations thereof are used in the embodiments described above, these terms are intended to be inclusive, as is the term “comprising.” Furthermore, the term “or” as used in this disclosure is not intended to be exclusive OR.
[0180] (15) In the present disclosure, if articles are added by translation, such as a, an, and the in English, the present disclosure may include the fact that the noun following these articles is plural.
[0181] (16) In this disclosure, the term “A and B are different” may mean “A and B are different from each other.” The term may also mean “A and B are each different from C.” Terms such as “separate” and “combine” may be interpreted in the same way as “different.”
[0182] (17) Each aspect / embodiment described herein may be used individually, in combination, or switched between as needed in practice. Furthermore, notification of certain information (e.g., notification that "X is") is not limited to explicit notification, but may also be implicit (e.g., by not providing such notification).
[0183] Although the present disclosure has been described in detail above, it will be clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented in modified and altered forms without departing from the intent and scope of the present disclosure as defined by the claims. Accordingly, the descriptions in the present disclosure are illustrative and not restrictive in any way. [Explanation of symbols]
[0184] 1, 1A, 1B... Information setting system, 10-1, 10-J, 10-K, 10A-K... Terminal device, 11, 11A... Processing unit, 12, 12A... Storage device, 13... Communication device, 14... Display, 15... Input device, 20, 20A... Server, 21, 21A... Processing unit, 22, 22A... Storage device, 23... Communication device, 24... Display, 25... Input device, 111... Acquisition unit, 112... Generation unit, 113... Display control unit, 114, 114A... Setting unit, 115, 115A... Appearance processing unit, 116... Output unit, 211... Acquisition unit, 212... Generation unit, 213... Output unit, 214... Calculation unit, 215... Setting unit, 216... Appearance processing unit, P1... Head, P2... Torso, PR1~PR2A... Control program, V1~V3... Normal vector, VO... Virtual object
Claims
1. An acquisition unit that acquires a 3D virtual object to be displayed in a virtual space, A setting unit sets viewing information indicating whether each of the multiple regions constituting the surface of the three-dimensional virtual object is viewable or not. The system comprises a display-prohibited object, which is a virtual object whose display in the virtual space is prohibited, and a calculation unit that calculates the similarity between the three-dimensional virtual object acquired by the acquisition unit, The calculation unit extracts multiple feature points from both the display-prohibited object and the three-dimensional virtual object, and calculates the similarity based on the degree to which the feature points of both match. The setting unit extracts areas that cannot be viewed using the similarity, The setting unit inputs image information representing the three-dimensional virtual object and image information representing the inaccessible region into the learning model, and causes the learning model to output the region that constitutes the surface of the three-dimensional virtual object corresponding to the inaccessible region. The setting unit sets access information indicating that the region output from the learning model is not accessible. The learning model is an information setting device generated by learning training data which includes multiple sets of training data, each set consisting of (a1) image information of a three-dimensional virtual object and (a2) image information of each region included in a display-prohibited object, and image information indicating the region within the virtual object corresponding to each region.
2. The information setting device according to claim 1, further comprising an appearance processing unit that deletes at least the area set as inaccessible from the three-dimensional virtual object among the plurality of areas.
Citation Information
Patent Citations
Game device, game control method and game control program
JP2009213722A
Augmented reality direction orientation mask
JP2015172941A
Rendering of content in 3D environment
JP2020098618A
Method and system for creating a video advertisement with embedded user content
US20170163907A1
Information processing device, video generation method, and program
WO2021059669A1