Content correction device and content correction method

Abstract

To provide a content correction device and content correction method that achieve avoidance of VR sickness and cost reduction upon converting a 2D-based content into a VR content.SOLUTION: In a content correction system having a content correction device communicably connected to a plurality of user terminals via a network, the content correction device 100 comprises: a storage unit 101 that holds 3DCG data on an object included in a content to be displayed in a 2-dimensional environment; a measurement unit 1021 that calculates an actual size of the object; a processing unit 1022 that analyzes viewpoint movement processing at a time when displaying the content; and a generation unit 1023 that converts the content into a VR content. When the actual size of the object is larger than a physical size of a user, the generation unit 1023 is configured to dispose the 3DCG data on the object on a rotation operation-purpose table serving as the object in the VR content.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a content correction device and a content correction method. [Background technology]

[0002] Simulation learning technology using 3DCG is evolving in the fields of operating, assembling, disassembling, and inspecting various things such as various devices and structures. By appropriately utilizing learning content based on this technology, users can easily understand a wide range of procedures and precautions without actually handling the target devices.

[0003] As a conventional technology relating to such content, a management system technology that makes it easy to create VR content (see Patent Document 1) has been proposed.

[0004] This technology converts object data in a specific format into object data in a common format that is different from the specific format, and manages VR (Virtual Reality) content including the object data in the common format and a setting file that stores the state of the object data in the common format in a virtual space. The present invention relates to a VR content management system that includes an object creation device that creates object data in the specific format and uploads it to the server, a content creation device that creates VR content including object data in the common format downloaded from the server and a setting file that saves the state of the object data in a virtual space and uploads the setting file to the server, and a viewing device that allows a viewer to virtually experience immersion in the VR content to be viewed that has been downloaded from the server.

[0005] Also, a system, method, and device for sharing and displaying 2D and 3D content have been proposed (see Patent Document 2).

[0006] The technology relates to a non-transitory computer-readable storage medium that stores program instructions that are computer-executable to perform operations, the operations including obtaining two-dimensional (2D) content referenced by a content item for display via an application on a display of a first device; detecting that the content item references three-dimensional (3D) content associated with the 2D content; detecting that a second device is in communication with the first device, where the second device is capable of displaying the 3D content referenced by the content item; and identifying the 3D content referenced by the content item to the second device. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] Japanese Patent Application Publication No. 2019-168934 [Patent Document 2] Japanese Patent Application Publication No. 2020-074058 Summary of the Invention [Problem to be solved by the invention]

[0008] The 2D content based on the above-mentioned 3DCG technology is certainly useful. However, it is content that is intended to be played and viewed on the 2D screen of a PC or tablet device. However, depending on the actual size of the learning object and the characteristics of the surrounding environment, this may lead to a lack of immersion and realism, and the expected learning effect may not be achieved.

[0009] Therefore, if the above-mentioned 2D-based content is converted into VR (Virtual Reality) content in order to make learning more immersive and realistic, even more favorable learning effects can be expected at low cost.

[0010] However, the GUI representation methods for 2D-based content and VR content are different, and if 2D-based content is applied directly to VR content, major problems are likely to arise in terms of usability.

[0011] Specifically, in 2D-based content, when the viewpoint reaches a specific area, there are cases where GUI control is used to automatically move the viewpoint so that the user can view areas adjacent to that area or areas in the depth direction.

[0012] However, if this control is applied to VR content in the same way, the resulting movements would be difficult to imagine given normal human behavior, and the user would likely experience so-called VR sickness.

[0013] The specific background to the occurrence of the VR sickness mentioned above is that in VR content, which is a life-size, first-person perspective viewing experience, the user's own body remains stationary, but the field of view in front of the user's eyes moves rapidly within the VR content, causing a "visually induced sense of self-motion."

[0014] On the other hand, even if all objects in 2D-based content were uniformly corrected to be VR-compatible in order to prevent such VR sickness, there would be limitations in terms of cost and effort.

[0015] Therefore, an object of the present invention is to provide a technology that prevents VR sickness and reduces costs when converting 2D-based content into VR content. [Means for solving the problem]

[0016] The content correction device of the present invention, which solves the above problem, comprises a memory unit that stores 3DCG data of an object included in content to be displayed in a two-dimensional environment, a measurement unit that calculates the actual size of the object based on the 3DCG data, a processing unit that analyzes the viewpoint movement process when the content is displayed, and a generation unit that converts the content into VR content, and is characterized in that, if the actual size of the object calculated by the measurement unit is larger than the body size of the user of the content, whose information is stored in advance, the generation unit places the 3DCG data of the object on a table for rotation operation, which is an object in the VR content.

[0017] Furthermore, the content correction method of the present invention is characterized in that an information processing device includes a memory unit that stores 3DCG data of an object included in content to be displayed in a two-dimensional environment, a measurement unit that calculates the actual size of the object based on the 3DCG data, a processing unit that analyzes the viewpoint movement process when the content is displayed, and a generation unit that converts the content into VR content, and when the actual size of the object calculated by the measurement unit is larger than the body size of a user of the content whose information is stored in advance, the generation unit places the 3DCG data of the object on a table for rotation operation, which is an object in the VR content. [Effects of the Invention]

[0018] According to the present invention, it is possible to avoid VR sickness and reduce costs when converting 2D-based content into VR content. [Brief explanation of the drawings]

[0019] [Figure 1] FIG. 1 is a diagram illustrating a network configuration including a content correction device according to an embodiment of the present invention. [Figure 2] FIG. 2 is a diagram illustrating an example of the hardware configuration of a content correction device according to the present embodiment. [Figure 3] FIG. 10 is a diagram showing an example of the flow of a content correction method according to the present embodiment. [Figure 4] FIG. 10 is a diagram showing an example of a screen in this embodiment. [Figure 5] FIG. 10 is a diagram showing an example of a screen in this embodiment. [Figure 6] FIG. 10 is a diagram showing an example of a screen in this embodiment. [Figure 7] FIG. 10 is a diagram showing an example of a screen in this embodiment. [Figure 8] FIG. 10 is a diagram showing an example of the flow of a content correction method according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0020] <Network configuration> Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. 1 is a diagram illustrating a network configuration including a content correction device 100. The content correction device 100 shown in Fig. 1 is a computer that aims to prevent VR sickness and reduce costs when converting 2D-based content into VR content.

[0021] 1, the content correction device 100 of this embodiment is communicably connected to a user terminal 200 via an appropriate network 1 such as the Internet or a LAN (Local Area Network). Therefore, these may be collectively referred to as a content correction system 10.

[0022] The content correction device 100 of this embodiment is designed for playback and output on a 2D screen such as a tablet terminal or a general PC (Personal Computer) display, that is, it can be said to be a service providing device for converting 2D-based content into VR (Virtual Reality) content and playing it back.

[0023] On the other hand, the user terminal 200 is a terminal on which the above-mentioned VR content is played. This user terminal 200 is a playback device for training content for performing training in operations, etc., and is the playback destination of VR content converted and generated from 2D-based content by the content correction device 100 of this embodiment. Specifically, the user terminal 200 is assumed to be a device for viewing VR content (such as so-called VR glasses). <Hardware configuration> The hardware configuration of the content correction device 100 of this embodiment is as shown in FIG.

[0024] That is, the content correction device 100 includes an auxiliary storage unit 101 , a main storage unit 103 , a calculation unit 104 , and a communication unit 105 .

[0025] Of these, the auxiliary storage unit 101 is a storage device configured with an appropriate nonvolatile storage element such as an SSD (Solid State Drive) or a hard disk drive.

[0026] The main memory unit 103 is a storage device configured with volatile memory elements such as RAM (Random Access Memory).

[0027] The calculation unit 104 also transfers the program 102 stored in the auxiliary storage unit 101 to the main storage unit 102. The CPU (Central Processing Unit) reads and executes the program data from the memory 03, performs overall control of the device itself, and also performs various judgments, calculations, and control processes.

[0028] The communication unit 105 is assumed to be a network interface card or the like that is connected to the above-mentioned network 1 and is responsible for communication processing with the user terminal 200 .

[0029] If the content correction device 100 is a stand-alone machine, it is preferable to further include an input device that accepts key input or voice input from the user, and an output device such as a display that displays processed data.

[0030] The auxiliary storage unit 101 also stores a training content DB 1011 in addition to a program 102 for implementing functions required for the content correction device of this embodiment. The training content DB 1011 is a database that stores 2D-based content to be played back and displayed on a display such as a tablet terminal.

[0031] This content is, for example, content for training in the operation of various devices, and is content that allows a user to observe and operate the devices in a virtual space. Originally, as described above, it is 2D-based content, and is not made into VR content. The content generation unit 1023 of the content correction device 100 of this embodiment converts the 2D-based content into VR content based on its 3DCG data in response to an instruction from the user terminal 200, and the VR content becomes the content.

[0032] Furthermore, the program 102 is a program for implementing the functions of the content correction device of the present invention, and as shown in FIG. 2, it is provided with programs corresponding to each function, such as a size measurement unit 1021, a viewpoint movement processing unit 1022, a content generation unit 1023, a rotation control unit 1024, and a work area display unit 1025. <Flow example> The actual procedure of the content correction method according to this embodiment will be described below with reference to the accompanying drawings. The various operations corresponding to the content correction method described below are realized by a program that is read into a memory or the like and executed by the content correction device 100. This program is composed of code for performing the various operations described below.

[0033] As already mentioned, the content correction method of this embodiment efficiently corrects viewpoint movement so that 3DCG-based training content created for playback on 2D screens such as PC displays and tablet devices can be viewed on a VR (Virtual Reality) compatible headset without excessive discomfort (without causing VR sickness).

[0034] Developing VR content from scratch without selecting such a correction method requires considerable cost and effort, and is hardly an optimal solution in a situation where existing training content exists. Therefore, if the content correction method of this embodiment is used to appropriately modify training content using 3DCG and make it possible to play it in the form of VR content, excellent improvements can be expected in terms of both effort and cost.

[0035] An example flow of the content correction method in this embodiment will be shown with reference to Fig. 3. In this case, the content generation unit 1023 of the content correction device 100 reads training content corresponding to an instruction from the user terminal 200, for example, from the training content DB 1011 in the auxiliary storage unit 101 into the main storage unit 103 (s10). The training content read here consists of 3DCG data to be displayed on a 2D screen such as a normal display.

[0036] Here, the content generation unit 1023 of the content correction device 100 performs the above-mentioned The 3DCG data of the embedded training content is played back and output to the user terminal 200, which is the VR glasses, and operation instructions are received from the user terminal 200 (see FIGS. 4 and 5).

[0037] The mechanism for providing operational instructions here is similar to that of existing VR glasses, and observes events such as the viewpoint, viewpoint (and eyeball) movement, and blinking of the user wearing the user terminal 200 as operational instructions, and feeds these observation values ​​back from the user terminal 200, which is the VR glasses, to content playback control in the content correction device 100, etc.

[0038] Therefore, the viewpoint movement processing unit 1022 of the content correction device 100 acquires from the user terminal 200 the observation value of a specific viewpoint movement for an object corresponding to the equipment being trained (hereinafter, the target equipment) in the above-mentioned training content displayed on the user terminal 200 (s11).

[0039] In this case, the movement of the viewpoint does not target any kind of viewpoint movement, but rather targets, for example, the part of the above-mentioned target equipment that corresponds to the part and timing at which the viewpoint should be moved to the next training operation position.

[0040] For example, when a user is performing a predetermined training action while observing part A of a target device and the training action is completed, the viewpoint movement processing unit 1022 of the content correction device 100 senses that the position and timing have arrived for moving the viewpoint to part B (e.g., a part in the blind spot from the above-mentioned part A) that is the target of the next training action.

[0041] It is to be noted that the content correction device 100 naturally holds and is capable of recognizing information in advance regarding the procedure, target, and timing of the training action in the above-mentioned content.

[0042] Next, the size measurement unit 1021 of the content correction device 100 calculates the volume and height as the actual size of the object, that is, the target device, based on the 3DCG data in the training content (s12).

[0043] This calculation involves, for example, calculating the volume and height of an object formed by connecting each vertex shown in the 3DCG data of the target device, or the volume and height of a bounding box (a rectangular parallelepiped that surrounds the entire object).

[0044] The rotation control unit 1024 of the content correction device 100 determines whether the result of the calculation in s12, i.e., the volume and height of the target device, are equal to or greater than a predetermined standard (s13). These standards are assumed to be the standard volume and standard height of a human. The content correction device 100 is assumed to store these standard values ​​in the auxiliary storage unit 101.

[0045] As a result of the above-mentioned determination, if the actual size of the target device is not equal to or larger than the standard (s13: No), the work part display unit 1025 of the content correction device 100 does not perform any particular viewpoint movement process, but displays, for example, an arrow object 1201 as exemplified in Fig. 6 in the direction indicating the target part of the next training action as described above (s15), and accepts an operation event from the user. The operation event here is related to the operation accompanying the next training action, in which the user moves around the object in the virtual space according to the above-mentioned arrow.

[0046] On the other hand, if the result of the above determination is that the actual size of the target device is equal to or larger than the standard (s13: Yes), the rotation control unit 1024 of the content correction device 100 places the object 1301 of the target device on an object 1302, which is an object for VR and indicates a turntable for rotation operation, and displays it on the user terminal 200 as shown in FIG. 7 (s 14) In other words, the user will view the target device placed on a turntable in a virtual space using VR glasses or similar.

[0047] The work part display unit 1025 of the content correction device 100 executes the above-mentioned s14, and displays, for example, an arrow object in the direction indicating the target part of the next training motion (s15), and receives an operation event from the user.

[0048] The operation events here are related to the operation of rotating the turntable in the direction of the arrow mentioned above, and the predetermined training action performed on the object that has undergone such rotation.

[0049] After executing the above-mentioned s15, the content correction device 100 receives an instruction to end the training motion from the user terminal 200, and ends this flow.

[0050] It is preferable that the content correction device 100 stores and holds in the auxiliary storage unit 101 the history of VR conversion of 2D-based training content, linked to the type and characteristics of the object.

[0051] In this case, when converting to VR in the future, if the target device for the 2D content that was previously converted to VR is similar to the target device this time (for example, the type of device is a server device), the selection control for the viewpoint movement processing (whether to place objects on the turntable or only place arrow objects) will be selected in the same way as in the past, and the processing will be automated.

[0052] An example of the flow in this case is shown in Figure 8. Here, the content correction device 100 reads (new, unVR-converted) 2D training content from the training content DB 1011 in the auxiliary storage unit 101 (s20), and determines whether the training content and the target device have a similar history (s21).

[0053] If it is determined that there is no history relating to a similar device (s21: No), the content correction device 100 ends the process (s23).

[0054] On the other hand, if the result of the above determination is that there is history related to a similar device (s21: Yes), the content correction device 100 performs VR conversion based on the corresponding history in the auxiliary storage unit 101 (s22) and terminates the processing.

[0055] The best mode for carrying out the present invention has been specifically described above, but the present invention is not limited to this and can be modified in various ways without departing from the spirit of the present invention.

[0056] According to this embodiment, it is possible to avoid VR sickness and reduce costs when converting 2D-based content into VR content.

[0057] The description in this specification makes at least the following clear: That is, in the content correction device of this embodiment, when the actual size of the object is larger than the body size, the generation unit may place 3DCG data of the object on the table in the VR content and display a predetermined object pointing in the direction of a predetermined next work target portion.

[0058] This allows the user to control the user's viewpoint of the object (device, etc.) that is being operated by the user, thereby avoiding VR sickness and allowing the user to accurately determine the direction in which to point the viewpoint next and proceed with the next action.

[0059] In addition, in the content correction device of this embodiment, if the actual size of the object is smaller than the body size, the generation unit may not add viewpoint movement for the object in the VR content, but may display a predetermined object pointing in the direction of a predetermined next work target area.

[0060] According to this, under conditions where there is little risk of the user experiencing VR sickness, control that enables turntable operation can be avoided, thereby improving overall processing efficiency.

[0061] Furthermore, in the content correction method of this embodiment, when the actual size of the object is larger than the body size in the generation unit, the information processing device may place the 3DCG data of the object on the table in the VR content and display a predetermined object pointing in the direction of a predetermined next work target area.

[0062] Furthermore, in the content correction method of this embodiment, when the actual size of the object is smaller than the body size, the information processing device may display, in the generation unit, a predetermined object pointing in the direction of a predetermined next work target part, without adding viewpoint movement for the object in the VR content. [Explanation of symbols]

[0063] 10 Content Correction System 100 Content Correction Device 101 Auxiliary storage 1011 Training Content DB 102 Programs 1021 Size measurement section (measurement section) 1022 viewpoint movement processing unit (processing unit) 1023 Content Generation Unit (Generation Unit) 1024 Rotation control unit 1025 Work area display section 103 Main memory 104 Arithmetic section 105 Communications Department 200 user terminals

Claims

1. The system includes a storage unit that stores 3DCG data of an object included in content displayed in a two-dimensional environment, a measurement unit that calculates the actual size of the object based on the 3DCG data, a processing unit that analyzes a viewpoint movement process when the content is displayed, and a generation unit that converts the content into VR content, When the actual size of the object calculated by the measurement unit is larger than the body size of a user of the content whose information is stored in advance, the generation unit places the 3DCG data of the object on a table for rotation operation, which is an object in the VR content. A content correction device comprising:

2. The generation unit When the actual size of the object is larger than the body size, 3DCG data of the object is placed on the table in the VR content, and a predetermined object pointing in the direction of a predetermined next work target portion is displayed.

2. The content correction device according to claim 1.

3. When the actual size of the object is smaller than the body size, the generation unit does not add a viewpoint movement related to the object in the VR content, and displays a predetermined object pointing in the direction of a predetermined next work target part.

2. The content correction device according to claim 1.

4. The information processing device The system includes a storage unit that stores 3DCG data of an object included in content displayed in a two-dimensional environment, a measurement unit that calculates the actual size of the object based on the 3DCG data, a processing unit that analyzes a viewpoint movement process when the content is displayed, and a generation unit that converts the content into VR content, If the actual size of the object calculated by the measurement unit is larger than the body size of a user of the content whose information is stored in advance, the generation unit places the 3DCG data of the object on a table for rotation operation, which is an object in the VR content. A content correction method comprising:

5. The information processing device, When the actual size of the object is larger than the body size, the generation unit places the 3DCG data of the object on the table in the VR content, and displays a predetermined object pointing in the direction of a predetermined next work target portion.

5. The content correction method according to claim 4.

6. The information processing device, When the actual size of the object is smaller than the body size, the generation unit does not add viewpoint movement related to the object in the VR content, and displays a predetermined object pointing in the direction of a predetermined next work target part.

5. The content correction method according to claim 4.

Images