Double-spiral structure type virtual reality simulator

Abstract

To provide a headgear prototype for developing a learning genetic engineering simulator, capable of constructing and manipulating a double-spiral structure such as DNA in a virtual reality space.SOLUTION: There is provided a headgear in which an aerial image generating device 100 is disposed, two compact projector light sources 11, 12 capable of sequentially emitting four types of sector-shaped images are mounted on a light source section of the image generating device, a control board 13 for an electromagnetic shutter and a filter changing program is mounted on an electronic material section, an optical element section has a configuration in which a semi-transparent retroreflective plate SRR18, a half-mirror HM unit 14 and the like are arranged symmetrically around a beam splitter BS15, and a display section is equipped with a high-quality half-mirror HHM16. A user can create an aerial image block arranged in layers with two spirals winding at the center along the line of sight by using such a configuration, and these form a double-spiral pattern consisting of ATGC base sequences such as DNA.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a technique for creating a virtual reality image on the line of sight axis in a manner of doubling it when a user wears a headgear.

Background Art

[0002] So far, headgears capable of displaying virtual reality images in front of or behind a transparent display applicable as a portable theater have been developed by various research institutions (see, for example, Document 1). When a user wears the headgear and looks into the display unit, a moving image floating in the air can be viewed on the line of sight. Thereby, the user can be immersed in a sense of immersion.

[0003] In recent years, in order to enhance the user's sense of immersion in video viewing in the above headgear, tests for optimizing the basic performance (resolution, brightness, field of view angle) of the aerial image have been conducted by various research institutions (see, for example, Document 2). In fact, probably due to the improvement of the aerial image quality, the user's sense of immersion in the headgear has increased, and the result is shown in the growth of the virtual reality device market.

[0004] On the other hand, in terms of functionality, there is also a reported example of changing an image by operating a machine through interlocking drive combining an aerial image and a mechanical unit. However, the usage of the drive-type virtual reality image is difficult, and it is limited at present. Perhaps, in this case, it is not suitable for video viewing, and a form specialized for games is desirable.

[0005] Currently, in action and shooting games, a mechanism to realistically drive aerial images using appropriate tools (such as a joystick) has already been developed. Sony's PSVR and Nintendo's Wii have made this partially possible. Specific usage examples of these devices include the linkage between ignition and torque gauges in a car race, the linkage between a lever and a spring gauge in a slot, the linkage between a reel and an interaction gauge in fishing, and the linkage between a swing and a power gauge in baseball and tennis. It seems that users are satisfied by actually using the stick to operate the image in a way similar to real experience. Furthermore, in recent years, the linkage driving technology between a shot trigger and a laminated optical sight image, as reported by inventors, is not inferior to the above-mentioned developed products (see Document 3, Paper [1]). Considering all aspects, it is predicted that such drive-type virtual reality imaging will lead to further growth in the relevant device market. Reference [1] Y. Ogata, “Double aerial sights assisted arm shooter device”, OpticaOpen, Dec. 19, 2023

[0006] Although a large market is expected to be formed in the game field, from the perspective of consumers, the above-mentioned new types of games do not give a very good impression to the parents of children in the world. This is because they know that children's immersion in games tends to neglect their studies. Therefore, from the perspective of developers, it is most natural to consider the application in training games (simulators) where learning can be done with a game feeling.

[0007] Then, which fields of learning are recommended for children's learning? Among many fields of learning, life science learning is very important in life, and engineering learning is important from the perspective of manufacturing. Therefore, bioengineering is recommended. Currently, the government's investment in research institutions throughout the year is mostly in the field of bioengineering, so there is no mistake.

[0008] Therefore, in the present invention, a virtual reality simulator specialized for the field of biotechnology is configured. As far as the inventor knows, there are still no application examples from a microscopic perspective in genetic engineering of a drivable virtual reality device. In particular, there is no case where a double helix structure such as deoxyribonucleic acid (DNA) is visualized and manipulated as an aerial image, and if it can be realized, a lot of knowledge should be obtained in genetic engineering.

[0009] To address such issues, the inventor creates an optical device that generates a double helix complementary pair aerial image consisting of the base sequences A (adenine), T (thymine), G (guanine), and C (cytosine) on the user's line of sight. The user will be able to visualize DNA when wearing the headgear. Furthermore, it is combined with a drive device that can perform repair, destruction, or recombination on the ATGC block images in the helix arrangement. After wearing the headgear, the user will be able to virtually modify DNA by manually performing some operation. As a result, the envisioned optical drive device can become a completely new simulator that enables base sequence manipulation in virtual reality space through the manipulation of aerial images.

Prior Art Documents

Patent Documents

[0010]

Patent Document 1

Patent Document 2

Patent Document 3

Summary of the Invention

Problems to be Solved by the Invention

[0011] Therefore, the present invention has been made in view of the above-mentioned conventional problems, and aims to develop a headgear capable of constructing the double helix structure of DNA in virtual reality space.

Means for Solving the Problem

[0012] To solve the above problems, the present invention prototyped a headgear that creates an aerial image with two hierarchically arranged chiralities behind or in front of the display as shown in FIG. 1. Its configuration consists of a light source unit, an optical element unit, a display unit, and an electronic material unit.

[0013] Such a double helix hierarchical image device mechanism of the present invention is characterized in that a pair of small projectors (PP) equipped with LEDs or lasers are provided in the light source unit, a half mirror (HM), a cross cube beam splitter (XBS), and a semi-transmissive retroreflective plate (SRR) are provided in the optical element unit, a highly transmissive high-quality half mirror (HM) generally used for aerial image generation is provided in the display unit, and a control board (EB) for an electromagnetic shutter opening / closing program and a bandpass filter change program is provided in the electronic material unit.

[0014] By appropriately arranging the above light source part, a small pair projector (PP) using a laser or an LED can separate the DNA double helix shape configured on a PC into two ribonucleic acids (RNAs) and display them respectively. Since the display on each PP is one section of 4 blocks of the base sequence ATGC of the RNA composition, the PP images are displayed in series in 4 divisions. Note that deoxyribose and phosphate are not visualized.

[0015] By appropriately arranging the above optical element part, the 4-divided base sequence PP images can be placed on one optical path and guided. A total of 4 types of ATGC base images on the same optical path are emitted in the display direction. Since the projectors are used in pairs, a total of 8 types of images of 4 (types) x 2 (pairs) can be emitted to the display unit.

[0016] By appropriately arranging the display part, an aerial image with a double helix structure consisting of 4 blocks and 1 section of ATGC can be constructed in a virtual space in front of the display. The creation of such an aerial image with a double helix laminated structure enables the three-dimensional simulation display of the ATGC base sequence in DNA, making it suitable for learning the basics of genetics.

[0017] By appropriately driving the electronic part, the ATGC blocks that make up the helix structure can be partially repaired, destroyed, or recombined behind or in front of the display. Such a driving technology in virtual reality can simulate the repair, destruction, and recombination of DNA, and should be useful for learning genetic engineering.

[0018] Furthermore, in one aspect of the present invention, in addition to the above simulation learning, it contributes to the cultivation of bioengineering researchers. When successful in their cultivation through DNA repair, destruction, and recombination simulation training, ultimately, contributions and active roles can be expected in the rapid recovery of intractable diseases, pest control, food security, etc.

Effects of the Invention

[0019] In the present invention, a DNA image with a double helix structure is visually constructed in a virtual reality space, and by additionally facilitating operations such as repair, destruction, and recombination, it serves as a simulation of genetic engineering for learning, having the effect of stimulating users' curiosity about genetic engineering.

Brief Description of the Drawings

[0020]

Figure 1

Figure 2

Figure 3

Figure 4

Embodiments for Carrying Out the Invention

[0021] (First Embodiment) Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The same or equivalent components, members, and processes are denoted by the same reference numerals, and repeated explanations are omitted as appropriate. FIG. 1 shows a schematic diagram of a double helix hierarchical aerial image seen in this embodiment. FIG. 2 shows a block diagram of the optical arrangement. FIG. 3 shows the state of the interlocking of device driving and image change. Note that general materials such as optical elements and electronic materials are used for the materials of this embodiment.

[0022] In the stationary mode, as shown in FIG. 1, the double helix hierarchical aerial image appears as if looking into DNA from the c-axis direction on the user's line of sight. That is, DNA is formed by a chain sequence of ATGC bases, RNA 1 and RNA 2, bound to phosphoric acid and deoxyribose (sugar), and it means that the situation of forming complementary pairs through the bonds between A-T and G-C in its two chiralities can be visualized from the c-axis direction. In visualization, the user can determine the base sequence by color. Here, a state is set in which one color is assigned to one type of nucleic acid molecule, and a total of four beam wavelengths are set. For example, the setting of A (red), T (blue), G (green), and C (yellow) is preferable. The user will be able to overlook the entire DNA base sequence in a form like looking down into a cylindrical pipe from above, where the aerial image of the nucleic acid looks large at a position close to the viewpoint and small at a distant position.

[0023] As far as the inventor knows, in the latest analysis of DNA, angle-resolved ultraviolet photoelectron spectroscopy (ARUPS) for measuring the kinetic energy distribution of electrons emitted by ultraviolet irradiation with the incident angle swept on the sample surface has been the mainstream [2] for electronic structure analysis. However, the learning effect can be enhanced if it is used in combination with the method of the present invention that visualizes the entire DNA strand by color-coding the base sequence on the c-axis. Reference [2] R. Friedlein* , Y. Wang, A. Fleurence, F. Bussolotti, Y. Ogata, and Y. Y-Takamura, Stacks of Nucleic Acids as Molecular Wires: Direct Measurement of the Intermolecular Band Dispersion in Multilayer Guanine Assemblies, J. Am. Chem. Soc., 132, 12806 (2010)

[0024] The optical arrangement of the double helix layer aerial image is composed of a light source unit having a small projector (PP) loaded with a laser or LED, a display unit with a high-quality half mirror (HHM) configuration necessary to show the aerial image, a half mirror (HM) for aligning the optical paths of multiple beams, a cross cube beam splitter (XBS) for integrating all beams and guiding them to the display unit, an optical element unit with a semi-transmissive retroreflective plate (SRR) that can control the beam incident angle in some cases, and an electronic material unit equipped with a program board (EB) for controlling the opening / closing and wavelength of the aerial image, as shown in Fig. 2 The details of the optical path will be described below

[0025] As shown in Fig. 2(a), first, a DNA helix structure is obtained on a PC, and then it is separated into two RNA strands using software. The base sequences of the two separated RNA strands are imaged block by block and transferred as S1(L), S2(L), S3(L), S4(L) for the first strand and S1(R), S2(R), S3(R), S4(R) for the second strand to a small projector (PP) equipped with a laser or LED. The 4 (types) x 2 (pairs) images (S) emitted from the PP are reflected by a half mirror (HM) and guided on the same optical path towards a cross-cube beam splitter (XBS). Here, the number of images displayed in series on one PP can be four or more, but in that case, the number of HMs also needs to be increased. In any case, don't forget to set the area not emitted on the PP to black regardless of the number. The light reflected by the XBS travels towards a high-quality half mirror (HHM) that serves as a display, where it is also reflected and proceeds towards the user's viewpoint. Here, when wanting to obtain a virtual image at the display destination on the user's line of sight, the incident angle of the image light needs to be positive (diffused), and when wanting to obtain a real image in front of the display, the incident angle of the image light needs to be negative (condensed).

[0026] When setting the incident angle to negative (condensed), as shown in Fig. 2(b), it is desirable to use a semi-transmissive retroreflective plate (SRR) on the side part of the XBS in the optical path. The SRR is a perforated plate processed in a form like Othello (to put it simply, the leapfrog algorithm of the leapfrog calculation used in the finite difference time domain (FDTD) method) composed of commercially available microbeads or microcubes, and it is desirable to have a configuration where optical absorption processing is applied to its back surface.

[0027] Although not shown in the figure, the configuration is an optical configuration that can visualize the axis of one RNA strand per eye, and it doesn't matter if DNA is constructed and visualized with both eyes. In that case, instead of the docking configuration shown in Fig. 2, a single-eye corresponding configuration with two display part HMs prepared and two BSs prepared instead of one XBS is fine. In the double helix configuration corresponding to both eyes, it is possible to perform stereoscopic viewing of DNA by superimposing each LR aerial image by gazing at it.

[0028] The drive mechanism of the double helix layer aerial image assumes that in the dynamic mode, as shown in Figure 3, the drive operation on the device and the change of the aerial image are linked. Although there are two drive parts corresponding to RNA1 and RNA2, each is set for the coupled drive of acid-base pair correspondence. Therefore, the user can arbitrarily repair, destroy, or recombine the aerial image. The four blocks of the aerial image ATGC as seen in Figure 1 are linked to the four optical paths composed of beams of different wavelengths as seen in Figure 2. Therefore, it is possible to drive and respond according to different situations (repair, destruction, recombination). The details will be described below.

[0029] In the simulation related to DNA repair, as shown in Figure 3(a), for example, it is an operation to automatically construct a helix from one nucleic acid. In this case, it can be executed by the ON / OFF operation of the electromagnetic shutter (or light-shielding plate with actuator) system. That is, considering the base of S1 as the starting point, in the situation where the electromagnetic shutter has blocked all except S1, when S2, S3, and S4 are sequentially opened, the user will feel that the DNA is being automatically repaired.

[0030] In the simulation related to DNA destruction, as shown in Figure 3(b), for example, it is an operation to create partial defects from the helix structure. In this case, an operation is required for the electromagnetic shutter to partially block from the fully open state with respect to the optical path. That is, in the state where all bases from S1 to S4 are visible, when the optical path for S2 is blocked, for example, the user will feel that the S2 deficiency (partial destruction) of the DNA has occurred.

[0031] In the simulation related to DNA recombination, as shown in Fig. 3(c), for example, it is an operation to rewrite the complementary pair part. In this case, when A is replaced with T, the corresponding color is changed using a band-pass filter change program. If it is difficult, simply vary the live image of the light source unit using a program. Anyway, it is only necessary to directly change the color from A (red) to T (blue) at the light source unit. Then the user can visually understand the fact of recombination.

[0032] For the electrical signal control in electromagnetic shutter and filter drive, an in-built driver unit or an electronic board installed with a self-made program is used. Whether the electronic board used is programmed in C language, Python, or Arduino, the type of software does not matter. Also, a remote control function can be added using Bluetooth, etc. The type of the board used does not matter as long as it can communicate, but the HC-05, HC-06 series are suitable. Anyway, as long as it is a configuration that allows the user to arbitrarily control the ON / OFF of the image and the wavelength.

[0033] In addition, in order to avoid the influence of crosstalk of the images on the same optical path after the half mirror HM, it is also devised to use an optical or mechanical chopper in addition to the above electromagnetic shutter and filter control device. In particular, in this study, since the wavelength of the image light is limited to a single color, a crosstalk problem is considered to occur. Therefore, the mutual shutter function by chopper drive is an effective countermeasure. As a specific countermeasure, the experimental arrangement of the mutual shutter for avoiding the electric field synthesis in the orthogonal direction of the linearly polarized beam seems to be versatile (see the following reference [3]). Reference [3] Y. Ogata * and C. Guo * ,Nonlinear Optics on Nano / Micro Hierarchical Structures on Metals: Focus on Symmetric and Plasmonic Effects, Nano Reviews & Exp., 8, 1339545(2017)

[0034] The application scope of such virtual reality devices becomes a learning virtual reality simulator that can be used in the field of biotechnology. It is also useful for analyzing molecular structures with chirality such as DNA. It is expected to be useful for future learning related to genetics.

[0035] (Second Embodiment) Next, the second embodiment of the present invention will be described below. Descriptions of the content overlapping with the first embodiment will be omitted. In the first embodiment, a double helix hierarchical image and a typical implementation configuration and usage example of the device constituting the same were shown. In this embodiment, attention is paid only to the aerial image in front of the display, and physical contact with a finger or the like to the created image is proposed. Note that FIG. 4 shows the state of physical contact with virtual DNA.

[0036] In the second embodiment, when a double helix image is created in front of the display, attention is paid to the photon population that is focused together with the image creation. The focused photon population can be touched with a finger, and the reaction can be sensed through a sensor. Specifically, as shown in FIG. 4, the user obtains a feeling of touching a part of the base in the DNA helix using a highly sensitive optical sensor attached to the finger.

[0037] As a more specific physical mechanism of the above configuration, a combination of an optical trap and an optical sensor is adopted. As shown in FIG. 4, first, the image focused in front of the display can also be treated as a spatial optical trap technique. Here, if the focusing power related to the focus in space is low, the magnetic optical trap (commonly known as MOT) technique with an added magnetic field may be used for reinforcement (see Proceedings [4] below). If a mechanism can be created that converts the obtained micro pressure into electricity (inverts) through a piezoelectric element or the like and transmits it as a stimulus to the user's body, a tactile recognition of touching the DNA helix structure in the virtual reality can be obtained when the finger touches the focus point. Refer to [4] Y. Ogata, G. Mizutani, and A. Hatakeyama, Toward the Development of a Technique Quantum Manipulation on the Surface of Metallic Nanowires, conference proceedings, International Symposium on Atomic Level Characterizations for New Materials and Devices’13 (ALC‘13), 05P58 (2013)

[0038] On the other hand, it seems necessary to measure a small amount of photons with another monitor and synchronize it with the above physical contact. In that case, it is generally considered that the collected light is recovered, photoelectric conversion using a photomultiplier tube (PMT), electrical signal amplification using an amplifier / preamplifier (Amp / preamp), noise removal using a boxcar, and the signal is dropped onto a PC in real time through digital signal conversion using an analog / digital (A / D) converter (see paper [5]). As another method, extraction of a signal buried in noise using a lock-in amplifier is also effective (see paper [6]). These are techniques often used in nonlinear spectroscopy, but they should also have a good relevance to the present invention. Refer to [5] Y. Ogata * and G. Mizutani, Control of Cross-Sections and Optical Nonlinearity of Pt Nanowires and the Roughness Effect, Phys. Res. Inter., 2012, 969835 (2012) Refer to [6] Y. Ogata, V. A. Vorobyev, and C. Guo *,Symmetry-Sensitive Plasmonic Enhancement of Nonlinear Optical Intensity in Nano-Micro Hierarchical Structures on Silver,Surf.Interface Anal.,48,1108-1113(2016)

[0039] Furthermore, by applying different amounts of electrical stimulation to each of ATGC to the user, it becomes possible to tactilely understand what is in which part of the DNA double helix, and it also becomes possible to understand the sequence without using vision.

[0040] The application range of such a stimulus-type virtual reality device is, as in the first embodiment, a learning virtual reality simulator that can be used in the field of biotechnology. However, the learning elements and user attraction elements as a simulator are higher than the effects obtained in the first form, and it is expected to be useful for future learning regarding genetic engineering.

[0041] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention.

Explanation of Reference Numerals

[0042] 100.... Double helix imaging device 10.... Small terminal such as PC or smartphone (collectively referred to as PC) 11.... Laser or LED type small projector (PP); RNA1 side 12.... Laser or LED type small projector (PP); RNA2 side 13.... Electromagnetic and filter change shutter (SH) 14.... Half mirror (HM) 15.... Cross cube beam splitter (XBS) 16.... High-quality half mirror (HHM) 17. ... Driver, electronic boards (EB) 18. ... Semi-transmissive retroreflective plate (SRR)

Claims

1. An aerial image generation device is arranged at a predetermined position. The light source unit in the image generation device is equipped with two small projector light sources capable of emitting four types of images in series. The electronic material unit is equipped with a control element for an electromagnetic and filter change program. The optical element unit has a configuration in which a semi-transmissive retroreflective plate SRR, a half mirror HM unit, etc. are symmetrically arranged around a beam splitter BS. The display unit is equipped with a high-quality half mirror HHM. Using such a configuration, the user can create an aerial image block hierarchically arranged with two vortices in the center on the line of sight, and they can form a double helix pattern consisting of an ATGC base sequence like DNA. A double helix hierarchical structure virtual reality image device.

2. The double helix hierarchical structure virtual reality image device according to Claim 1, which can be configured regardless of the number of hierarchical images of the base sequence.

3. The drive type double helix hierarchical structure virtual reality image device according to Claims 1 and 2, which can perform virtual repair, destruction, and recombination by virtually adding, deleting, and replacing each base block in DNA.

4. The double helix hierarchical structure virtual reality image device according to Claims 1, 2, and 3, which enables the interaction between virtual and reality and can give an electric stimulus to the user when a virtual base block is touched with a finger, etc. by using optical trap and optical sensor technologies in combination.

Images