Head-mounted display

Abstract

To efficiently display content on an HMD while securing visibility.SOLUTION: When the head-mounted display analyzes the content and detects that the content is process data in which text data and image data correspond to each other on a one-to-one basis for each process, the head-mounted display displays only the text data among the text data and the image data included in the content in a predetermined region which is a part of the display region of the display based on the process, and when the head-mounted display detects that the content is not the process data, the head-mounted display treats the image data of the content as a break of the content instead of the process and displays up to the break in the text data of the content as one block.SELECTED DRAWING: Figure 7

Description

[Technical Field]

[0001] The present invention relates to a head mounted display (HMD). play). [Background technology]

[0002] The Internet is connected to web servers that provide a wide variety of information content, and It can be viewed and read from computers, smartphones, and other information devices. A browser is used and is installed as part of the basic operating program of information devices. Generally, the equipment has a user interface that requires manual input, so it is difficult to use information equipment to BIt's difficult for users to do other tasks while viewing content.

[0003] On the other hand, virtual objects such as graphics and text (Argument Reality Objects) There are HMDs that display images of a virtual object superimposed on the real world and allow the user to view them. The user wears an HMD and watches content such as games and operation support for equipment. Even when using a handheld device, you should be able to operate game machines and other equipment using your hands, which you can move freely. This can be done.

[0004] As an example of HMD display technology, Patent Document 1 describes a combination of a mobile terminal, which is an information device, and an HMD. The paper discloses a method for linking these devices to display the screen of a mobile device on the HMD screen. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2011-186856 Summary of the Invention [Problem to be solved by the invention]

[0006] The display area of ​​the HMD screen is generally smaller than that of a mobile device, so simply using the mobile device screen as an HMD is not enough. Simply displaying the image on the MD screen does not ensure sufficient visibility for the wearer of the HMD. On the other hand, even if the same content is displayed on both the mobile device and the HMD, The wearer mainly looks at the HMD screen, so there is no need to display the same content on both. Therefore, it is necessary to decide which content to display on the HMD screen, which has a small display area, and There is room for further improvement in how to ensure recognizability.

[0007] The present invention has been made in consideration of the above points, and provides an HMD that can efficiently display content. This relates to a technology for displaying information while ensuring its reliability. [Means for solving the problem]

[0008] In order to solve the above problems, the present invention has the configurations described in the claims. For example, the head-mounted display includes a display and a processor, and the processor analyzes content, and when it detects that the content is process data in which text data and image data correspond one-to-one for each process, it displays only the text data of the text data and image data contained in the content in a predetermined area that is part of the display area of ​​the display based on the process, and when it detects that the content is not process data, it treats the image data of the content as a break in the content that replaces a process, and displays the text data of the content up to the break as one block on the display. [Effects of the Invention]

[0009] According to the present invention, it is possible to display content on an HMD efficiently while ensuring visibility. Objects, configurations, and effects other than those described above will become apparent from the following embodiments. to be turned into [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram showing the configuration of a cooperative display system of an information device and an HMD according to an embodiment of the present invention. [Figure 2] Front view of the information device [Figure 3] Hardware configuration diagram of information equipment [Figure 4] Appearance of the HMD [Figure 5] HMD hardware configuration diagram [Figure 6] Functional configuration diagram of the linked display system [Figure 7] A diagram showing an example of display switching using the linked display system [Figure 8] A diagram showing an example of display switching using the linked display system [Figure 9] 10 is a flowchart showing a process for analyzing content on the information device side. [Figure 10] Flowchart showing the process of analyzing content on the HMD side [Figure 11] FIG. 10 shows an example of content used in the second embodiment. [Figure 12] FIG. 10 is a diagram showing a display example of an HMD in a second embodiment. [Figure 13] FIG. 1 shows an example of content used in the first embodiment. [Figure 14] FIG. 10 is a diagram showing a display example of an HMD in a second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. The same reference numerals are used for the components, and duplicated explanations will be omitted.

[0012] [First embodiment] FIG. 1 shows a configuration of an information device and an HMD (head mounted display) according to this embodiment. 1 shows the configuration of a display system.

[0013] In Fig. 1, 1 is a user, 2 is an information device, 3 is an HMD, 4 is an access point, 2a, 3 a, 4a are communication signals, 5 is a network, and 6 is a web server.

[0014] User 1 is viewing web content in one of two scenes, SCENE1 and SCENE2. The two scenes are displayed in the order of browsing and viewing. In the following explanation, the information device 2 searches for and receives web content. We refer to the act of viewing a display screen by connecting to a device as browsing, and the act of viewing a virtual screen of web content with an HMD. It is written that this is a viewing.

[0015] In SCENE 1, User 1 uses information device 2 to view web content. The information device 2 is connected to the network 5 via communication signals 2a and 4a and an access point 4. The web content of the web server 6 connected to the network 5 is searched for, and the desired web page is selected. B receives the content, displays it on information device 2, and allows user 1 to view the web content. do.

[0016] The communication signals 2a and 4a are preferably wireless LAN signals, which are used for communication over the Internet. By utilizing the widely used TCP / IP and HTTP protocols, Can be viewed.

[0017] Network 5 is an integrated representation of the Internet and the Intranet. Proxy servers and the like installed between the Internet and the intranet are not shown in the figure. is doing.

[0018] User 1 can access web content by entering keywords or URLs into information device 2. This limits the user's ability to do things. When 1 tries to perform a task that requires hand movement while browsing web content, S Transition from Scene 1 to Scene 2. For example, a recipe explaining how to make a dish. You can search for relevant web content and actually cook while watching that web content, Search for the instruction manual of the home appliance on the Internet and use the instruction manual There are cases where electrical appliances are handled.

[0019] User 1 is connected to information device 2 (corresponding to the "first information device") and HMD 3 (corresponding to the "second information device"). ") wirelessly connects to the HMD3, pauses the web content, and The scene where HMD3 is worn is SCENE2.

[0020] The HMD3 is, for example, an optical see-through HMD or a video see-through HMD. In the following description, the MD 3 will be explained as an HMD 3 of an optical see-through type.

[0021] The HMD3 allows users to see the real world through an optical screen while viewing a virtual screen projected by a display optical system. The virtual screen shows part of the web content that was being viewed on Information Device 2 just before. In this embodiment, the image is only text data.

[0022] The HMD 3 is connected to a network 5 via communication signals 3a and 4a and an access point 4. and can receive web content from the web server 6. Web content may also be received.

[0023] The communication signals 2a and 3a are transmitted and received by wirelessly connecting the information device 2 and the HMD 3. The communication signals 2a and 3a at this time may be wireless LAN signals. It may be a Bluetooth (registered trademark) signal. The signal is used for one-to-one communication between the information device 2 and the HMD 3, and the pairing of the information device 2 and the HMD 3 is performed. The linked display system 10 is comprised of an information device 2 and an HMD 3. This is a system that connects the devices via communication and controls the display.

[0024] Information device 2 displays the URL of the web content that was being viewed just before and the progress of viewing on HMD 3. The HMD3 transmits data such as the time and date of the event, and the HMD3 displays the web content corresponding to the received data. The content is received from the network 5 and projected onto the display optical system, allowing continuous display of the web content. Allows viewing.

[0025] (Information equipment) An example of the information device 2 will be described with reference to Figures 2 and 3. Figure 2 shows a front view of the external appearance of the information device 2. FIG. 3 is a hardware configuration diagram of the information device.

[0026] In Figure 2, 2b is the home button, 2c is the ambient light and proximity sensor, 2d is the earpiece, and 2e is In-camera, 2f is a notification lamp, 2g is a touch panel display ("1st display" The display area (also called a virtual screen) corresponds to the area (a) of the display screen (also called a virtual screen). However, the side of the information device 2 has a volume button and a power button, and the bottom has a speaker, microphone, power supply and and / or communication connector, earphone jack, rear camera, fingerprint sensor, etc. The placement location does not have to be as shown in Figure 2.

[0027] In FIG. 3, 201 is a camera (there are at least two cameras, one in and one out), 202 is a Ambient light sensor, proximity sensor, GPS sensor, gyro sensor, geomagnetic sensor, acceleration sensor 203 is a graphics processor, and 204 (2g in Fig. 2) is a touch panel. 205 is a microphone and speaker, 206 is a wireless communication device ("first communication device"). 207 is the CPU (corresponding to the "first processor"), 208 is the RAM, 20 9 is Flash ROM (FROM), 212 is external interface (I / F), 213 is an internal bus.

[0028] FROM 209 is a basic operation program 210 of the information device 2 and an HMD linkage application 211 (Installed on the information equipment) programs, and these programs are CP U207 expands the processing program into RAM208 and executes it. Data generated during the execution process and results can be stored.

[0029] The wireless communication device 206 supports mobile communication such as 4G, wireless LAN communication, Bluetooth (registered trademark) communications.

[0030] The touch panel display 204 displays the image drawn by the graphics processor 203. The image is displayed on the display unit, and the touch panel accepts user input. The user can enter URLs and other information using the keyboard displayed on the display. Browse the content.

[0031] (HMD) An example of the HMD 3 will be described with reference to Fig. 4 and Fig. 5. Fig. 4 is an external view of the HMD 3. Figure 5 shows the hardware configuration of the HMD.

[0032] In FIG. 4, 30 is a camera, 31 is a distance measuring device, 32a and 32b are projection optical systems, and 33 is The display optical system includes lenses and a screen, 34 is a nose pad, 35 is a processor, and 36 is a screen. The speaker, 37, and 38a, 38b, and 38c are frame housings.

[0033] The user 1 attaches the HMD 3 to his or her face using the frame housings 38a and 38b and the nose pad 34. Attach to the part.

[0034] The camera 30 is attached so as to capture an image in front of the user's line of sight, and 31 denotes a real object in real space captured by the image (corresponding to the "forward image") captured by the camera 30. Measure the distance between.

[0035] The distance measuring device 31 measures feature points such as the contours of real objects using a method such as a stereo camera. It can be a method that calculates distance by using the time of flight (TOF) method. It may also be a device that measures distance by projecting light rays two-dimensionally onto a real object in response to the captured image. Any device capable of measuring the distance to the body may be used. It includes a distance calculator 351 (see FIG. 5).

[0036] The projection optical systems 32a and 32b and the display optical system 33 form a display unit ("second display") of the HMD 3. The projection optical systems 32a and 32b project the image of the virtual object onto the left eye. The image to be confirmed and the image to be confirmed with the right eye are projected and displayed on the display optical system 33. 1 can see the scenery and real objects in front of it through the display optical system 33, and the projection optical system The images of the virtual objects projected from 32a and 32b are projected onto the real world through a display optical system 33. The distance measuring device 31 can be displayed at any position where it can be easily distinguished from the real object. In this case, the virtual screen is displayed at a preset position in the real space.

[0037] The processor 35 (corresponding to the "second processor") processes the real space captured by the camera 30. and the position data of the real space such as the image of the real object acquired by the distance measuring device 31. It also supplies data to the internal memory and CPU. It also includes gyro, orientation, position, and contact sensors, as well as It has a built-in group of gaze detection sensors.

[0038] Furthermore, the processor 35 controls the images projected by the projection optical systems 32a and 32b and the output to the speaker 36. The processor 35, the camera 30, the distance measurement device 31, the speaker 36, The microphones 37 are arranged in the frame housings 38a, 38b, and 38c. It doesn't have to be number 4.

[0039] In FIG. 5, the same components as those in FIG. 4 are assigned the same numbers. 350 is an internal bus, 351 is a distance calculator, 352 is a group of sensors, 354 is a wireless communication device, 355 is a CPU, and 356 is a RA M, 357 is the image RAM, and 358 is FROM.

[0040] The projection optical system 32 corresponds to the projection optical systems 32a and 32b in FIG. An image for the left eye and an image for the right eye are projected independently onto a display optical system 33 as shown by 32a and 32b. In addition, a single projector projects interleaved left and right eye images, The left eye image and the right eye image may be transmitted to each eye by a single optical system. Furthermore, an optical system using a holographic lens may also be used.

[0041] The wireless communication device 354 (corresponding to the "second communication device") connects the HMD 3 to an access point on a wireless LAN. The device is connected to a network 5 via a Bluetooth® access point 4. One-to-one communication is performed with information device 2 via communication, etc.

[0042] FROM358 contains the processing program, the basic operation program 580, and the HMD link program. These processing programs are executed by the CPU 355. Furthermore, FROM358 is the process of executing the processing program. The resulting data can be stored.

[0043] The image data to be sent to the projection optical system 32 is stored in the image RAM 357. Read from 357.

[0044] 6 is a program function block diagram of the linked display system 10. The U207 loads the HMD linkage application 211 into the RAM208 and executes it. It comprises a display control unit 401, a content analysis unit 402, and a communication control unit 403. HMD The CPU 355 of the third embodiment loads the HMD-linked application 358 into the RAM 356 and executes it. The display control unit 501, the content analysis unit 502, the communication control unit 503, and the gaze detection unit 504. The function of each unit will be described later with reference to the flowcharts of FIGS.

[0045] 7 and 8 are diagrams showing examples of display switching by the linked display system 10. FIG.

[0046] In display state A (all content display state) of FIGS. 7 and 8, information device 2 and HMD 3 When the text data is transferred from the information device 2 to the HMD 3 via a communication connection, the display state becomes B1 (Fig. 7) or display state B2 (see FIG. 8). When input from HMD3, the display state transitions from B1 or B2 to A. .

[0047] In display state A, that is, when the content is displayed only on the information device, The content includes the store data and image A. Touch panel display 2 At the right end of the 04 screen 2g, there is a scroll bar 2g for moving the display screen forward and backward. 1 is placed.

[0048] In display state B1, only image A is displayed on information device 2, and text data is displayed on HMD3. The display size of image A in display state B1 is the same as that of image A in display state A. The display size is enlarged compared to A. The display on HMD3 is called "AR." However, the virtual object displayed on the HMD3 (in the example in Figure 7) is not a real object or position. It is not necessary for the data (equivalent to text data) to be linked.

[0049] In display state B1, the text data is shifted to the left in the display area (virtual screen) of the HMD3. This ensures visibility in the center of the field of view of the person wearing HMD3 (user 1). do.

[0050] Also, as shown in display state B2, the text data is shifted to the top of the virtual screen of HMD3. This ensures visibility in the center of the field of view of the wearer of the HMD 3. When the wearer of the HMD 3 is working while looking downward at his / her hands or a real object, for example, when cooking, When working with a virtual object, the virtual object is displayed only in the upper part of the virtual screen of the HMD3. The position where the virtual object is displayed can be adjusted depending on the work status. It can be set at the bottom or either the left or right side. The display position can be decided by the wearer or by HM The HMD3 may set it automatically. When the HMD3 sets it automatically, the out-camera Detect the range of hand movement and select a location within the HMD3 display area that does not overlap with the range of the wearer's hand movement. Display it on.

[0051] The display control unit 501 of the HMD 3 controls the display of the text data in each of the display states B1 and B2. When the number of characters in the data is too large to fit on the virtual screen, arrows are used to scroll the virtual screen. A virtual object M in the shape of a mark is displayed on the virtual screen of the HMD 3 together with text data. The mark selection area M1 is configured as a closed area that contains the virtual object M. Area M1 is an area where it is determined that the line of sight has selected the arrow.

[0052] The gaze detection unit 504 captures an image of the face of the wearer of the HMD 3 using the in-camera, and determines the gaze from the face image. Detect the line direction. Then, when it is detected that the wearer's line of sight has come into the arrow selection area M1, The display control unit 501 shifts the displayable area of ​​the HMD 3 in the direction of the arrow. The information device 2 then notifies the information device 2 that the screen has been scrolled. The image associated with the newly displayed text data is image B, which is different from image A. In this case, the display is switched from image A to image B.

[0053] 9 and 10 explain the processing flow of the linked display system. In S100, the application is started. The following process is performed when the main power of the information device 2 and the HMD 3 is turned on and the information device 2 and the HMD 3 are turned on. The HMD link app is running on each D3 device and pairing is complete. Start from there.

[0054] FIG. 9 is a flowchart showing the process of analyzing content on the information device 2 side.

[0055] A state in which text data and image A are displayed on information device 2 (display state A). In step (2), the user performs an operation to switch the information device 2 to a viewing mode using the HMD 3. (S101).

[0056] The communication control unit 403 of the information device 2 checks whether the HMD is connected (S102).

[0057] The content analysis unit 402 of the information device 2 extracts only the text from the displayed content, Text data is generated (S103).

[0058] The content analysis unit 402 outputs the generated text data to the communication control unit 403 . The communication control unit 403 transmits the text data from the wireless communication device 206 to the HMD 3 (S10 4).

[0059] The communication control unit 503 of the HMD 3 receives the text data via the wireless communication device 354. A transmission completion signal is transmitted to information device 2 (S105).

[0060] The display control unit 501 of the HMD 3 converts the received text data into a font for display on the HMD, The size, color, etc. are adjusted (S106), and the projection optical system 32 and the display optical system 33 are used. The text is displayed on the HMD3 (S107).

[0061] Display control unit 501 transmits the text of the display portion from wireless communication device 354 to information device 2. (S108).

[0062] The content analysis unit 402 determines the image corresponding to the text displayed on the HMD 3. The display control unit 401 enlarges and displays the image on the touch panel display 204 of the information device 2 ( S109).

[0063] If all the text has not been displayed (S110 / NO), the display control unit 501 The text continues to be displayed in D3 (S107).

[0064] Although all text is displayed (S110 / YES), the text display on HMD3 If the operation is to be continued (S111 / NO), the display control unit 501 stops the display of the text on the HMD 3. Continue (S107).

[0065] To end the text display on the HMD3 (S111 / YES), A display end signal is transmitted to information device 2 (S112).

[0066] When the display control unit 401 of the information device 2 receives the display end signal, the display control unit 401 of the information device 2 Return (S113).

[0067] FIG. 10 is a flowchart showing the process of analyzing content on the HMD 3 side. The same steps as those in the previous embodiment are denoted by the same reference numerals, and redundant explanations will be omitted.

[0068] When it is confirmed whether the information device 2 and the HMD 3 are connected (S102), The content data (text data and image data) is transmitted from the device to the HMD 3 (S201 ).

[0069] The HMD 3 receives the content data and sends a reception completion signal from the communication control unit 503 to the information device 2 (S202).

[0070] The content analysis unit 502 of the HMD 3 extracts the text portion from the received content data. The text data is extracted and generated (S203). Then, the information device performs the process for obtaining the information (S106) and displays the information (S107). 2 to enlarge the image.

[0071] In the above, the content analysis unit 502 of the HMD 3 and the content analysis unit 503 of the information device 2 There are various ways that 402 can separate text from images. For example, For ePUB format e-book data, the HTML, XML, and XHTML sources are analyzed. You can separate the text and image files. (Excluding text that is not displayed on information device 2, such as comments) Text data may also be generated.

[0072] On the other hand, images have directory information in the image tag, so you can directly The address may be called and the image displayed on information device 2.

[0073] In addition, for PDF data, the parts that can be written out using OCR etc. can be extracted as text data. You can put it out.

[0074] Furthermore, as a method for displaying only images on information device 2, for example, If you are browsing, you will need to use the URL (the location where the image file is stored on the server) to display the image. Since the address is read, you can simply display it.

[0075] On the other hand, if there is no image, the content that was displayed can be left as it is. This case is an exception to the above processing using content containing text and images. It is positioned as such.

[0076] According to the above embodiment, content including text and images is displayed between the information device 2 and the HMD 3. When linking these devices and displaying them together, only text data is displayed on HMD3, and only text data is displayed on information device 2. This allows the user to read text easily while wearing the HMD3. While viewing the information, the image is not displayed on the HMD3, improving visibility while wearing the HMD3. Furthermore, since the image is displayed enlarged on the information device 2, it is possible to visually confirm the image. When the user wishes to view the enlarged image, the user can view the enlarged image as a real image by looking at the information device 2, improving the visibility of the image. do.

[0077] [Second embodiment] The second embodiment differs from the first embodiment in content. The first step is to display the contents in which text and images are related to each other. 1 Different from the embodiment.

[0078] 11 is a diagram showing an example of content used in the second embodiment. 13 is a diagram showing a display example of the HMD in the first embodiment. 14 is a diagram showing a display example of the HMD 3 in the second embodiment.

[0079] Content 1 in Figure 11 is a content where images such as diagrams and photographs correspond one-to-one with text. For example, cooking recipes, sewing and gardening, stretching and muscle training training, etc. There is content that involves tasks such as grooming, putting on a kimono, and tying an obi. The attached images can be not only still images but also videos. The content of Image 1 is Image 1 and a description corresponding to Image 1, for example, a recipe for a dish. In the recipe, the photo of the ingredients preparation is in Image 1, and the text is about the preparation method. are written next to Image 1. Then, Image 2 and Image e The description for Image 2 is displayed below Image 1 and its corresponding description. It has been done.

[0080] The content analysis unit 502 of the HMD 3 and the content analysis unit 402 of the information device 2 are The criteria for recognizing that the content is displayed in accordance with the following criteria are, for example, Either one or any combination may be used. (Criterion 1) Text and images are arranged paragraph by paragraph into frames or tables. . (Criterion 2) The beginning of the text contains numbers or letters indicating the order. (Criterion 3) Image captions (for websites, <alt>(or tags) to indicate the order. The numbers or letters are written on it. (Criterion 4) The title text should include work procedures such as "procedures," "recipe," "how to do it," and "method." It contains a word that means order.

[0081] The content analysis unit 502 of the HMD 3 and the content analysis unit 402 of the information device 2 The content is either a frame, a table, or a paragraph, or any combination thereof. If it is judged that the process is divided into steps using the In this case, as shown in Figure 12, the HMD3 switches to state B2. Only the text of the content included in the image is extracted and displayed. The mark selection area M1 is displayed. Then, the line of sight detection unit 504 detects whether the user's line of sight is in the arrow selection area M1. When it detects that a predetermined time has passed since the last visit to M1, it outputs the detection result to the content analysis unit 502. The content analysis unit 502 then displays the content of the next step (process) to the display control unit 501. In the example in Figure 11, "step2. Boil the potatoes." can be configured as The updated display will be displayed on the HMD3 screen shown in Figure 1.

[0082] On the other hand, the content 2 in FIG. 13 is generated by the content analysis unit 502 of the HMD 3 and the This is an example of content that the content analysis unit 402 has determined not to be divided into steps.

[0083] Content 2 is for images such as diagrams and photographs that do not correspond one-to-one to text, for example It is content that you can simply read, such as news, columns, and blogs.

[0084] Content 2 is a title text of an article or column followed by an image such as a diagram or photograph (hereinafter ,<Fig.> ) and the text are not arranged one-to-one, and there is a < The content in which Fig.> is inserted is the content that the user mainly "reads". In this case,<Fig.> There is no rule about where the is inserted, and the content The author has inserted them as appropriate to the content.<Fig.> One may be inserted, or , and multiple insertions may be made.

[0085] The content analysis unit 502 of the HMD 3 and the content analysis unit 402 of the information device 2 perform the steps If the content is not recognized as being a process, We determine that the content is meant to be read, such as articles, columns, blogs, etc.

[0086] If the image is inserted into the content of a website (news, blog, etc.), Display according to the description position of the image insertion tag. Or, display according to the link such as URL where the image is stored. The link destination is read and displayed.

[0087] When displaying Word files or PDF files, the same as above, if the process can be recognized, For each process, if the process cannot be recognized, the image and text are separated as in the first embodiment. The image may be updated as the text scrolls. On the other hand, in the second embodiment, images are used as an index for determining breaks in content instead of processes. For example, "The Maxell Group... (hereafter referred to as "We")" The block is determined to be a partial data of the content and is displayed on the HMD3. If one block cannot be displayed within the display area of ​​the HMD3, as shown in Figure 14, , an arrow selection area M1 is displayed near the AR of the text. Then, the line of sight detection unit 504 When it is detected that the user's gaze has stayed on the arrow selection area M1 for a predetermined time, the content solution The detection result is output to the content analysis unit 502, and the content analysis unit 502 sends the next block to the display control unit 501. The content of the block may be displayed.

[0088] As shown in Figure 13, by displaying content that is not related to a process, For light tasks such as polishing or folding laundry, or tasks that do not require thinking, I want to read articles and other content that is easy to read, but I have to keep my hands moving. So if you can't hold the information device 2 or if you have the information device 2 nearby and you want to watch the screen, If you have to stop working every time, you can view the text (content) on the HMD3. By displaying the main part of the page, users can read the content without stopping what they are doing. There is an advantage in being able to

[0089] In contrast, when the second embodiment is used, which displays content for each step, for example, when cooking, In situations where you want to cook while looking at a recipe, you can go to the page of the recipe. There is no space in the kitchen to store open books, and it is a hassle to go back and look at books every time. I want to look at recipes on my smartphone or tablet, but I can't scroll by tapping the display with my finger. I want to look at recipes on information device 2, but the screen freezes after a certain amount of time. The display will be hidden (the display will be turned off), so even if you can't see it when you want to, you can still By wearing the MD3 and displaying the text part of the recipe on the HMD3, the user can You can check the recipe without having to choose a cooking method or getting your hands dirty.

[0090] In addition, the image can be displayed full screen (enlarged) on information device 2 to check the finished state.

[0091] If you want to read the text explanation and enlarge the image, you can use the information device 2 alone. This can be a good solution as there are some tasks that cannot be checked at the same time as the text.

[0092] Also, how to update and display the next steps (processes), content, and content of the next block. As a method, the arrow selection area M1 is displayed, and the user's gaze is directed to the arrow selection area M1 for a predetermined time. By keeping the container in place, you can easily use it even when your hands are full, such as when working. The contents can be updated and displayed.

[0093] The present invention is not limited to the above-described embodiments, and a part of the configuration of one embodiment may be used in another embodiment. In addition, the configuration of one embodiment may be replaced with the configuration of another embodiment. These all belong to the scope of the present invention and are not limited to the above. The numerical values ​​and messages appearing in the drawings are merely examples, and the present invention may be practiced even if different ones are used. This does not impair the effectiveness of the

[0094] In addition, the functions of the invention may be partially or entirely realized by designing them as an integrated circuit, for example. It may be implemented in hardware. Also, a microprocessor unit, CPU, etc. may be used as the operating processor. It may be implemented in software by interpreting and executing a program. This does not limit the scope of implementation of the software, and both hardware and software may be used.

[0095] For example, the image (still image, video) is displayed on the information device 2 that the user first saw. However, if the content is sent to a display device other than information device 2, such as a television or monitor, and displayed, It may be possible.

[0096] The camera in HMD3 captures the view in front of the wearer, including the field of view, and generates the content. The analysis unit 502 analyzes the state of the subject in the forward image and determines that the state of the subject is included in the next process. When the setting is made, the display control unit 501 is notified, and the display control unit 501 The text data may be updated to the text data associated with the next step. [Explanation of symbols]

[0097] 1: User 2a: Communication signal 2g:screen 2g1 :Scrollbar 3: HMD 3a, 4a: communication signal 4: Access point 5: Network 6: Web server 10: Collaborative display system 30: Camera 31: Ranging device 32, 32a, 32b: Projection optical system 33:Display optical system 34: Nose pad 35: Processor 36: Speaker 37:Mike 38a, 38b, 38c: Frame housing 203: Graphics processor 204: Touch panel display 206, 354: Radio communication equipment 207, 355: CPU 208, 356: RAM 210, 580: Basic operation program 211, 358: HMD linked apps 351:Distance Calculator 357: Image RAM 401, 501: Display control unit 402, 502: Content analysis section 403, 503: Communication control section 504: Gaze detection unit 581: Program M: Virtual Object M1: Arrow selection area< / alt>

Claims

1. A head-mounted display, The display and a processor; Equipped with The processor: Analyze the content, When the content is detected as process data in which text data and image data correspond one-to-one for each process, only the text data of the text data and image data included in the content is displayed in a predetermined area that is a part of the display area of ​​the display based on the process; If it is detected that the content is not the process data, the image data of the content is treated as a break in the content instead of a process, and the text data of the content up to the break is displayed on the display as one block. A head-mounted display characterized by:

2. The head-mounted display according to claim 1, When the processor analyzes that the text data and image data included in the content are arranged in paragraphs, it detects the content as the process data. A head-mounted display characterized by:

3. The head-mounted display according to claim 1, When the processor analyzes that a number or an alphabet indicating a sequence is written at the beginning of text data included in the content, it detects the content as the process data. A head-mounted display characterized by:

4. The head-mounted display according to claim 1, The processor detects the content as the process data when it analyzes that a number or an alphabet indicating a sequence is written in a caption or a tag of image data included in the content. A head-mounted display characterized by:

5. The head-mounted display according to claim 1, When the processor analyzes the text data included in the content to determine that it contains a word meaning a work procedure, it detects the content as the process data. A head-mounted display characterized by:

6. The head-mounted display according to claim 1, The process data is data showing work procedures for cooking, sewing, gardening, training, or putting on a kimono. A head-mounted display characterized by:

7. The head-mounted display according to any one of claims 1 to 6, the predetermined area is an area that does not overlap with the center of the field of view of the wearer of the head mounted display when the wearer works while looking downward at a hand or a real object. A head-mounted display characterized by:

8. The head-mounted display according to any one of claims 1 to 6, the processor detects that the content is the process data, and if the number of characters of the text data does not fit within the predetermined area, displays a virtual object on the display that displays the text data that could not be displayed. A head-mounted display characterized by:

Images