Virtual reality device and video comment display method

Abstract

The application provides a virtual reality device and a video comment display method. A video watched by a user using the virtual reality device in the application is usually displayed on a webpage, and the webpage includes comments and other content of the video in addition to a video display area. The virtual reality device can obtain comment content corresponding to the video when the video is displayed in a non-full screen mode. When the video is displayed in a full screen mode, the virtual reality device separately displays the comment content on another display interface, i.e., a 3D display control. When the video is displayed in a non-full screen mode, the 3D display control is at the back end of the video display interface, i.e., in a non-visible state. When the video is displayed in a full screen mode, the 3D display control is at the front end of the video display interface, i.e., in a visible state. In this way, the user can also watch the comment content synchronously when the video is displayed in a full screen mode on the virtual reality device, thereby enhancing the immersion in the 3D scene.

Description

Technical Field

[0001] This application relates to the field of virtual reality technology, and in particular to a virtual reality device and a method for displaying video comments. Background Technology

[0002] Virtual Reality (VR) technology is a display technology that simulates virtual environments using computers, thereby creating a sense of immersion. A VR device is a device that uses virtual reality technology to present virtual images to users. Among VR devices, a VR browser is an important tool for playing online videos. As long as the video webpage supports VR effects, a VR browser can display the video webpage.

[0003] In some current virtual reality devices, when watching video content on a webpage in full-screen mode using a VR browser, due to limitations in webpage design, only a full-size View window can be used to overlay the video content onto the webpage. This results in other content on the webpage being covered and invisible, such as comments below the video display area. Users can only view other users' comments when the browser is not displaying the video content in full-screen mode.

[0004] In fact, other users' comments on videos can bring a unique experience to viewers, increasing the enjoyment of the viewing experience. However, due to the current way browsers display videos in full-screen mode on virtual reality devices, users cannot see related comments when watching video content in full-screen mode, which greatly reduces the immersive experience of watching videos in 3D scenes. Summary of the Invention

[0005] This application provides a virtual reality device and a method for displaying video comments, in order to solve the problem that relevant comments cannot be seen when watching videos in full screen using a virtual reality device.

[0006] On one hand, this application provides a virtual reality device, including a display and a controller. The display is configured to display a virtual user interface. The controller is configured to: establish a 3D display control, wherein the 3D display control is a display interface independent of the virtual user interface; when the virtual user interface is not displaying video in full screen, control the 3D display control to be positioned behind the virtual user interface, and extract comment content corresponding to the video on the virtual user interface; when the virtual user interface is displaying video in full screen, control the 3D display control to be positioned in front of the virtual user interface, and display comment content on the 3D display control sequentially according to the comment time of the comment content.

[0007] Videos watched by users using the virtual reality device described in this application are typically displayed on a webpage, which includes video comments and other content in addition to the video display area. The virtual reality device can access the corresponding comment content when the video is not displayed in full-screen mode. When the video is displayed in full-screen mode, the virtual reality device displays the comment content separately on another display interface, namely a 3D display control. When the video is not displayed in full-screen mode, the 3D display control is at the back of the video display interface, i.e., in an invisible state. However, when the video is displayed in full-screen mode, the 3D display control is at the front of the video display interface, i.e., in a visible state. This allows users to simultaneously view the comment content while the video is displayed in full-screen mode on the virtual reality device, enhancing the immersive experience of watching videos in a 3D scene.

[0008] In some feasible implementations, the controller of the virtual reality device can also be configured to: determine whether a webpage, including a video, has been fully loaded; if the webpage has been fully loaded, obtain the hypertext markup language file of the webpage; extract the content of target tags in the hypertext markup language file; the content of the target tags includes several attributes corresponding to the comment content of the video; and filter the content of the target tags layer by layer to obtain the comment content of the video.

[0009] In some feasible implementations, the controller of the virtual reality device can also be configured to: obtain the content corresponding to the target attribute from the content of the target tag; the content of the target attribute includes all content in the video comment section; traverse the content of the target attribute to determine all target objects; each target object includes user information, comment time, comment content, and sub-comment content; extract the string content from each target object as the comment content of the video.

[0010] In some possible implementations, the controller of the virtual reality device can also be configured to: when the 3D display control is in the foreground of the virtual user interface, determine whether the number of display lines required for the comment content to be displayed exceeds a preset number of comment content that can be displayed on the 3D display control; if the number of display lines exceeds the preset number of lines, first display the preset number of lines of the comment content to be displayed on the 3D display control; after a preset time, re-display the remaining content of the comment content to be displayed on the 3D display control; after the next preset time, continue to determine whether the number of display lines required for the next comment content to be displayed exceeds the preset number of comment content that can be displayed on the 3D display control; wherein the comment time of the next comment content to be displayed is later than the comment time of the currently displayed comment content.

[0011] In some possible implementations, the controller of the virtual reality device can also be configured to: display the comment content to be displayed on the 3D display control if the number of display lines does not exceed the preset number of lines; and after a preset time, continue to determine whether the number of display lines required for the next comment content to be displayed exceeds the preset number of lines of comment content that can be displayed on the 3D display control.

[0012] On the other hand, this application also provides a video comment display method, applied to the aforementioned virtual reality device, the method comprising the following steps:

[0013] Establish a 3D display control; the 3D display control is a display interface independent of the virtual user interface;

[0014] When the video is not displayed in full screen on the virtual user interface, the 3D display control is controlled to be located behind the virtual user interface, and the comment content corresponding to the video on the virtual user interface is extracted;

[0015] When the video is displayed in full screen on the virtual user interface, the 3D display control is positioned at the front of the virtual user interface, and the comment content is displayed on the 3D display control in sequence according to the comment time of the comment content.

[0016] Since the method of the second aspect of this application can be applied to the virtual reality device of the first aspect, the beneficial effects of the second aspect are the same as those of the first aspect, and will not be repeated here. Attached Figure Description

[0017] To more clearly illustrate the technical solution of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 A schematic diagram of a display system structure including a virtual reality device is shown according to some embodiments;

[0019] Figure 2 A schematic diagram of a VR scene global interface according to some embodiments is shown;

[0020] Figure 3 A schematic diagram of the recommended content area of ​​the global interface according to some embodiments is shown;

[0021] Figure 4 A schematic diagram of the application shortcut operation entry area of ​​the global interface according to some embodiments is shown;

[0022] Figure 5A schematic diagram of a floating object in a global interface according to some embodiments is shown;

[0023] Figure 6 A schematic diagram illustrating the display of a video webpage in a content recommendation area according to some embodiments is shown;

[0024] Figure 7 A schematic diagram of a View window is shown when video is displayed in full screen in a virtual reality device according to some embodiments;

[0025] Figure 8 A flowchart illustrating a method for displaying video comments in a virtual reality device according to some embodiments is shown;

[0026] Figure 9 A schematic diagram of a 3D display control according to some embodiments is shown;

[0027] Figure 10 A schematic diagram showing a 3D display control located behind a virtual user, according to some embodiments, is illustrated.

[0028] Figure 11 A schematic diagram showing a 3D display control in front of a virtual user, according to some embodiments, is illustrated.

[0029] Figure 12 This diagram illustrates a method of displaying video comments using 3D display controls according to some embodiments;

[0030] Figure 13 Another schematic diagram illustrating the use of 3D display controls to display video comments according to some embodiments is shown;

[0031] Figure 14 A flowchart of a method for extracting comment content from a video according to some embodiments is shown;

[0032] Figure 15 A flowchart illustrating another method for extracting comment content from a video according to some embodiments is shown;

[0033] Figure 16 A schematic diagram illustrating a 3D display control displaying a user's name according to some embodiments is shown;

[0034] Figure 17 A schematic diagram illustrating the display of comment time using a 3D display control according to some embodiments is shown;

[0035] Figure 18 A flowchart illustrating a method for displaying comment content using a 3D display control according to some embodiments is shown. Detailed Implementation

[0036] To make the objectives, technical solutions, and advantages of the exemplary embodiments of this application clearer, the technical solutions in the exemplary embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described exemplary embodiments are only some embodiments of this application, and not all embodiments.

[0037] Based on the exemplary embodiments shown in this application, all other embodiments obtained by those skilled in the art without inventive effort are within the scope of protection of this application. Furthermore, although the disclosures in this application are presented by way of one or more exemplary examples, it should be understood that each aspect of these disclosures can constitute a complete technical solution on its own.

[0038] It should be understood that the terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate, for example, to allow implementation in orders other than those given in the embodiments illustrated or described in this application.

[0039] Furthermore, the terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclusively include, for example, a product or device that includes a series of components is not necessarily limited to those that are explicitly listed, but may include other components that are not explicitly listed or that are inherent to such product or device.

[0040] As used in this application, the term "module" means any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code capable of performing the functions associated with that element.

[0041] Throughout this specification, references to "multiple embodiments," "some embodiments," "one embodiment," or simply "embodiment" indicate that a specific feature, structure, or characteristic described in connection with that embodiment is included in at least one embodiment. Therefore, phrases such as "in multiple embodiments," "in some embodiments," "in at least another embodiment," or "in an embodiment" appearing throughout this specification do not necessarily refer to the same embodiment. Furthermore, in one or more embodiments, specific features, structures, or characteristics can be combined in any suitable manner. Therefore, without limitation, a specific feature, structure, or characteristic shown or described in connection with one embodiment may be combined, in whole or in part, with features, structures, or characteristics of one or more other embodiments. Such modifications and variations are intended to be included within the scope of this application.

[0042] In this application embodiment, the virtual reality device 500 generally refers to a display device that can be worn on a user's face to provide an immersive experience, including but not limited to VR glasses, augmented reality (AR) devices, VR gaming devices, mobile computing devices, and other wearable computers. Some embodiments of this application use VR glasses as an example to illustrate the technical solution; it should be understood that the provided technical solution can also be applied to other types of virtual reality devices. The virtual reality device 500 can operate independently or be connected as an external device to other smart display devices, wherein the display device can be a smart TV, computer, tablet computer, server, etc.

[0043] The virtual reality device 500, when worn on a user's face, displays media assets, providing close-up images to the user's eyes for an immersive experience. To present the media assets, the virtual reality device 500 can include multiple components for displaying the images and for wearing on the face. Taking VR glasses as an example, the virtual reality device 500 can include a shell, positioning fixtures, an optical system, a display component, a posture detection circuit, and interface circuits. In practical applications, the optical system, display component, posture detection circuit, and interface circuit can be housed within the shell to display the specific images; positioning fixtures are connected to both sides of the shell for wearing on the user's face.

[0044] When in use, the attitude detection circuit has built-in attitude detection components such as gravity acceleration sensor and gyroscope. When the user's head moves or turns, the user's attitude can be detected and the detected attitude data can be transmitted to the controller and other processing components, so that the processing components can adjust the specific screen content in the display component according to the detected attitude data.

[0045] like Figure 1 As shown, in some embodiments, the virtual reality device 500 can be connected to the display device 200 and a network-based display system can be built between it and the server 400. Data interaction can be performed in real time between the virtual reality device 500, the display device 200 and the server 400. For example, the display device 200 can obtain media data from the server 400 and play it, and transmit specific screen content to the virtual reality device 500 for display.

[0046] The display device 200 can be a liquid crystal display, an OLED display, or a projection display device. The specific type, size, and resolution of the display device are not limited. Those skilled in the art will understand that the display device 200 can be modified in terms of performance and configuration as needed. The display device 200 can provide broadcast television reception functionality and may also include, but is not limited to, intelligent network television functionality with computer support, including but not limited to, internet television, smart television, and Internet Protocol television (IPTV).

[0047] Display device 200 and virtual reality device 500 also communicate with server 400 via various communication methods. Display device 200 and virtual reality device 500 can communicate via local area network (LAN), wireless local area network (WLAN), and other networks. Server 400 can provide display device 200 with various content and interactive features. For example, display device 200 can interact by sending and receiving information, as well as electronic program guides (EPGs), receiving software updates, or accessing remotely stored digital media libraries. Server 400 can be a cluster or multiple clusters, and may include one or more types of servers. Other network services such as video-on-demand and advertising services can be provided through server 400.

[0048] During data interaction, users can operate the display device 200 via the mobile terminal 300 and the remote control 100. The mobile terminal 300 and the remote control 100 can communicate with the display device 200 via a direct wireless connection or a non-direct connection. Specifically, in some embodiments, the mobile terminal 300 and the remote control 100 can communicate with the display device 200 via direct connection methods such as Bluetooth or infrared. When sending control commands, the mobile terminal 300 and the remote control 100 can directly transmit the control command data to the display device 200 via Bluetooth or infrared.

[0049] In other embodiments, the mobile terminal 300 and the remote controller 100 can also access the same wireless network as the display device 200 via a wireless router to establish a non-direct connection communication with the display device 200 through the wireless network. When sending control commands, the mobile terminal 300 and the remote controller 100 can first send the control command data to the wireless router, and then the wireless router forwards the control command data to the display device 200.

[0050] In some embodiments, users can also use the mobile terminal 300 and the remote control 100 to interact directly with the virtual reality device 500. For example, the mobile terminal 300 and the remote control 100 can be used as controllers in a virtual reality scene to achieve functions such as motion-sensing interaction.

[0051] In some embodiments, the display component of the virtual reality device 500 includes a display screen and driving circuitry associated with the display screen. To present a concrete image and provide a stereoscopic effect, the display component may include two display screens, corresponding to the user's left and right eyes respectively. When presenting a 3D effect, the content displayed on the left and right screens will be slightly different, and can respectively display the left and right cameras used during the filming of the 3D source material. Because the user observes the image content with their left and right eyes, a more stereoscopic display image can be observed when the device is worn.

[0052] The optical system in the virtual reality device 500 is an optical module composed of multiple lenses. Positioned between the user's eyes and the display screen, the optical system increases the optical path through the refraction of light signals by the lenses and the polarization effect of polarizers on the lenses, ensuring that the content displayed is clearly presented within the user's field of vision. Furthermore, to accommodate different users' visual acuity, the optical system also supports focusing. This involves adjusting the position of one or more lenses using a focusing component, changing the distance between the lenses, and thus altering the optical path and adjusting the image clarity.

[0053] The interface circuit of the virtual reality device 500 can be used to transmit interactive data. Besides transmitting posture data and display content data, in practical applications, the virtual reality device 500 can also connect to other display devices or peripherals through the interface circuit to achieve more complex functions through data interaction with the connected devices. For example, the virtual reality device 500 can connect to a display device through the interface circuit to output the displayed image to the display device in real time. As another example, the virtual reality device 500 can also connect to a controller through the interface circuit, which can be held and operated by the user to perform related operations in the VR user interface.

[0054] The VR user interface can be presented in various different UI layouts based on user operations. For example, the user interface may include a global interface, such as the global UI after the AR / VR terminal is started. Figure 2 As shown, the global UI can be displayed on the display screen of the AR / VR terminal or on the display device's monitor. The global UI may include a recommended content area 1, a business category extension area 2, an application quick operation entry area 3, and a floating element area 4.

[0055] Recommended content area 1 is used to configure different category tabs; within these tabs, media assets, special features, etc., can be configured; the media assets may include 2D films, educational courses, tourism, 3D, 360-degree panoramic, live streaming, 4K films, applications, games, and other businesses with media asset content, and these tabs can select different template styles and support simultaneous recommendation and arrangement of media assets and special features, such as... Figure 3 As shown.

[0056] In some embodiments, the content recommendation area 1 may further include a main interface and a sub-interface. For example... Figure 3 As shown, the part located in the center of the UI layout is the main interface, while the parts located on either side of the main interface are the secondary interfaces. The main interface and the secondary interfaces can be used to display different recommended content. For example, based on the type of recommended content, the main interface can display 3D content; the secondary interface on the left can display 2D content; and the secondary interface on the right can display panoramic content.

[0057] Clearly, the main interface and sub-interfaces can display different content layouts while showing different business content. Furthermore, users can control the switching between the main and sub-interfaces through specific interactive actions. For example, by controlling the focus icon to move left and right, moving it to the right after it's at the far right of the main interface will center the sub-interface on the right side of the UI layout. At this point, the main interface switches to displaying panoramic content, the left sub-interface switches to displaying 3D content, and the right sub-interface switches to displaying 2D content.

[0058] Additionally, to facilitate user viewing, different display effects can be used to show the main interface and the secondary interface separately. For example, the transparency of the secondary interface can be increased to create a blurred effect, thus highlighting the main interface. Alternatively, the secondary interface can be set to grayscale while the main interface remains in color, further emphasizing the main interface.

[0059] In some embodiments, a status bar may also be provided at the top of the recommended content area 1. The status bar may contain multiple display controls, including commonly used options such as time, network connection status, and battery level. The content included in the status bar can be customized by the user; for example, weather or user avatars can be added. The content included in the status bar can be selected by the user to perform corresponding functions. For example, when the user clicks the time option, the virtual reality device 500 may display a time device window on the current interface or jump to a calendar interface. When the user clicks the network connection status option, the virtual reality device 500 may display a WiFi list on the current interface or jump to a network settings interface.

[0060] The content displayed in the status bar can vary depending on the specific settings of the project. For example, the time control can directly display the specific time text information, and display different text at different times; the battery control can display different pattern styles according to the current remaining battery level of the virtual reality device 500.

[0061] The status bar enables users to perform frequently used control operations, allowing for quick setup of the virtual reality device 500. Since the setup process for the virtual reality device 500 involves numerous steps, not all commonly used settings options can typically be displayed in the status bar. Therefore, in some embodiments, the status bar may also include extended options. When an extended option is selected, an extended window is displayed on the current interface, where multiple settings options can be further configured to implement other functions of the virtual reality device 500.

[0062] For example, in some embodiments, when the extended options are selected, a "Quick Center" option can be set in the extended window. After the user clicks the Quick Center option, the virtual reality device 500 can display the Quick Center window. The Quick Center window can include "Screenshot," "Screen Recording," and "Screen Casting" options, used to activate the corresponding functions respectively.

[0063] The Business Category Extension Area 2 supports configuring extended categories for different business types. When a new business type is added, a separate tab can be configured to display the corresponding page content. The extended categories in Business Category Extension Area 2 can also be sorted, and businesses can be removed from the platform. In some embodiments, Business Category Extension Area 2 may include the following content: Movies & TV, Education, Travel, Applications, and My Account. In some embodiments, Business Category Extension Area 2 is configured to display large business category tabs and supports configuring more categories; its icons are configurable, such as... Figure 3 As shown.

[0064] The application quick access area 3 can prioritize pre-installed applications for promotional purposes, and supports configuring special icon styles to replace default icons. Multiple pre-installed applications can be specified. In some embodiments, the application quick access area 3 also includes left-hand and right-hand movement controls for selecting different icons, such as... Figure 4 As shown.

[0065] The floating area 4 can be configured to be located above the left or right diagonal side of a fixed area, and can be configured as a replaceable image or a jump link. For example, after receiving a confirmation operation, the floating area can jump to an application or display a specified function page, such as... Figure 5 As shown. In some embodiments, the suspended object may not be configured with a jump link and may be used simply for visual display.

[0066] In some embodiments, the global UI also includes a status bar at the top for displaying the time, network connection status, battery status, and more quick access points. When an icon is selected using the AR / VR terminal's controller, the icon will display a text prompt that expands to the left and right, and the selected icon will stretch and expand to the left and right according to its position.

[0067] For example, after selecting the search icon, the search icon will display the text "Search" and the original icon. Clicking the icon or text will take you to the search page. Another example is that clicking the favorites icon will take you to the favorites tab, clicking the history icon will display the history page by default, clicking the search icon will take you to the global search page, and clicking the message icon will take you to the message page.

[0068] In some embodiments, interaction can be performed through peripheral devices, such as the controller of an AR / VR terminal, which can operate the user interface of the AR / VR terminal, including a back button; a home button, which can be long-pressed to achieve a reset function; volume up and down buttons; and a touch area that can realize the functions of clicking, sliding, holding and dragging the focus.

[0069] After operating on the VR user interface, the user can control the virtual reality device 500 to display a specific video resource. In the virtual reality device 500, a VR browser is typically used to play the video resource, and the video resource is displayed on a webpage in the VR browser, such as... Figure 6 As shown, the main interface in content recommendation area 1 can display a webpage including video display area 5. Other locations on the webpage can display recommended video content, comments, or video descriptions; for example, recommended videos can be displayed to the right of video display area 5, and comments can be displayed below video display area 5.

[0070] In virtual reality devices (VR devices), a VR browser is an important tool for playing online videos. As long as a webpage supports VR effects, a VR browser can display the video on the webpage. However, in some current VR devices, when viewing video content on a webpage in full-screen mode using a VR browser, due to limitations in webpage creation, only a full-size View window can be used to overlay the video content onto the webpage. This results in other content on the webpage being covered and invisible, such as… Figure 7 As shown, when the virtual reality device displays 500 full-screen... Figure 6 When displaying video in the middle video area, it is necessary to... Figure 6 A new display interface, the View window, is overlaid on the video webpage, and the video content is displayed in this View window. Figure 6 In this mode, all content on the webpage will be overwritten; users will only be able to see the video content and will not be able to see other content on the webpage, such as comments below the video display area. Users can only view other users' comments when the browser is not displaying the video in full-screen mode.

[0071] In fact, other users' comments on videos can bring a unique experience to viewers, increasing the enjoyment of watching. However, due to the current way virtual reality devices and browsers display videos in full screen, users cannot see relevant comments when watching video content in full screen, which greatly reduces the immersive experience of watching videos in 3D scenes.

[0072] To address the aforementioned problems, this application provides a virtual reality device 500, including a display and a controller. The display can be configured to display a virtual user interface, i.e., the VR user interface described in the above embodiments. Figure 8 As shown, the controller can be configured to perform the following steps:

[0073] Step S101: Create 3D display control 6.

[0074] In this embodiment, the 3D display control 6 is a display interface independent of the virtual user interface, and specific content can be displayed on the 3D display control 6. The virtual reality device 500 can begin establishing the 3D display control 6 when the virtual user interface is not displaying video in full screen.

[0075] Figure 9 A schematic diagram of a 3D display control according to some embodiments is shown. For example... Figure 9 As shown, the area of ​​the 3D display control 6 is smaller than that of the virtual user interface. Therefore, when the 3D display control 6 is displayed in front of the virtual user interface, the content displayed on the 3D display control 6 will only cover a part of the virtual user interface and will not completely cover the virtual user interface.

[0076] Step S102: When the video is not displayed in full screen on the virtual user interface, control the 3D display control 6 to be behind the virtual user interface, and extract the comment content corresponding to the video on the virtual user interface.

[0077] When a video is displayed in a non-full-screen virtual user interface, since the webpage containing the video can simultaneously display recommended content and comments, users can directly watch video comments and other content on that webpage, and the virtual reality device 500 does not need to display the comments separately.

[0078] At this point, to prevent the newly created 3D display control 6 from affecting the display of webpage content, it is necessary to place the 3D display control 6 behind the virtual user interface, such as... Figure 10 As shown, the 3D display control 6 is invisible when placed behind the virtual user interface, and the user will not see the 3D display control 6 when viewing the virtual user interface from the front.

[0079] Typically, before displaying a video in full-screen mode, the virtual reality device 500 first displays a webpage with a video display area 5. Only after the user selects to display the video in full-screen mode will the virtual reality device 500 respond to the user's command and display the video content in full-screen mode. To ensure that users can promptly access video comments while watching the video in full-screen mode, the virtual reality device 500 can extract the video comments from the webpage when displaying the webpage, allowing the comments to be displayed separately when the video is displayed in full-screen mode.

[0080] When the 3D display control 6 is placed behind the virtual user interface, the virtual reality device 500 can display the extracted comment content on the 3D display control 6, or it can not display the comment content, because the 3D display control 6 is invisible at this time, and even if the comment content is displayed, the user cannot see it.

[0081] In step S103, when the video is displayed in full screen on the virtual user interface, the 3D display control 6 is controlled to be in front of the virtual user interface, and the comment content is displayed on the 3D display control 6 in sequence according to the comment time of the comment content.

[0082] like Figure 11 As shown, the 3D display control 6 is visible when placed in front of the virtual user interface, and the user will see the content on the 3D display control 6 when viewing the virtual user interface in front of the virtual user interface.

[0083] Since the virtual reality device 500 has already extracted the video comments when the video is not displayed in full screen, it can directly display the comments on the 3D display control 6 when the video is displayed in full screen. At this time, users can not only watch the video content in full screen, but also watch the relevant comments in real time.

[0084] Figure 12 A schematic diagram illustrating the use of 3D display controls to display video comments, according to some embodiments, is shown. For example... Figure 12 As shown, the 3D display control 6 can be placed in the lower middle part of the front of the virtual user interface, or in the upper middle part of the front of the virtual user interface, or in other positions on the front of the virtual user interface.

[0085] Comments displayed on the 3D display control 6, such as "The entire universe was once in a scorching, dense state," can be displayed on a single line or across multiple lines, depending on the width of the 3D display control 6. If the width of the 3D display control 6 requires 10 characters to be displayed per line, then the above comment would appear as follows: Figure 12 As shown, it requires two rows on the 3D display control 6 to display. If the width of the 3D display control 6 requires 20 characters to be displayed per row, then the above comment would be... Figure 13As shown, it only needs to occupy one row on the 3D display control 6 to be displayed.

[0086] In this embodiment of the application, when the 3D display control 6 is created, the preset width of the 3D display control 6 and the preset number of lines of comment content that can be displayed are already determined. Then, the extracted comment content can be displayed according to the preset width and the preset number of lines.

[0087] Furthermore, to avoid the 3D display control 6 itself obscuring the video content, in this embodiment, apart from the comment content displayed on the 3D display control 6, all other parts of the 3D display control 6 are in a transparent state. For example, the 3D display control 6 can display three lines of comment content, but only two lines are actually needed. Therefore, the remaining line on the 3D display control 6 is transparent, and the user can only see two lines of comment content when watching the video in full screen. This displays comment content similarly to an aerial bullet screen effect, neither obscuring the video content nor obscuring the comment content itself, while still providing the user with synchronized comment display.

[0088] When a user watches video content using the virtual reality device 500 in this embodiment, the virtual reality device 500 can obtain the corresponding comment content when the video is not displayed in full screen. When the video is displayed in full screen, the virtual reality device 500 then displays the comment content separately on another display interface, namely the 3D display control 6. When the video is not displayed in full screen, the 3D display control 6 is at the back of the virtual user interface, i.e., in an invisible state. When the video is displayed in full screen, the 3D display control 6 is at the front of the virtual user interface, i.e., in a visible state. In this way, when the virtual reality device 500 displays the video in full screen, the user can also simultaneously view the comment content, enhancing the immersive experience of watching the video in the 3D scene.

[0089] Typically, the web pages displayed in virtual reality devices (VR devices) are the same as those displayed on televisions and other display devices. They all have corresponding Hyper Text Markup Language (HTML) files. HTML defines the meaning and structure of the web page content, and it also defines its own syntax rules to represent richer meanings than just "text," such as images, tables, and links. Simply put, HTML is the language of adding tags to text to indicate its meaning.

[0090] In the virtual reality device 500, web pages or videos are displayed on the virtual user interface via a browser. Since the browser understands HTML syntax, the virtual reality device 500 can view HTML files. Typically, after loading a web page, the virtual reality device 500 obtains the corresponding complete HTML file. After extracting the target tag content from the HTML file, the virtual reality device 500 can then extract comment content from that target tag content.

[0091] In the above process, such as Figure 14 As shown, the controller of the virtual reality device 500 can also be configured to perform the following steps:

[0092] Step S201: Determine whether the entire webpage, including the video, has been fully loaded.

[0093] Step S202: If the webpage has been fully loaded, obtain the hypertext markup language file of the webpage, i.e., the HTML file.

[0094] Step S203: Extract the content of the target tags from the Hypertext Markup Language file.

[0095] HTML files contain various tags, such as ``, ``, `<h3>`, etc. Different tags can contain different content, such as text, links, images, lists, tables, forms, and frames. The content in the video comment section of a webpage is generally located within...<h1> Therefore, before extracting comment content, it is necessary to first extract the tags. The content within the tag, i.e., the content of the target tag.

[0096] exist The tags include several attributes corresponding to the comment content, such as `comment` (attribute), `comments` (attribute), etc. Furthermore, the content of the video comment section is mostly concentrated in... The content of the attribute element with the id identifier "comment" or "comments" within the tag.

[0097] Step S204: Filter the content of the target tag layer by layer to obtain the video's comment content.

[0098] After step S203, the target tag content contains attribute elements related to comment content. In step S204, attribute elements with the id "comment" or "comments" can be further extracted from the target tag content to obtain the comment content in "comment" or "comments".

[0099] When extracting the comment or comments attribute element, the virtual reality device 500 can use a JavaScript interface to obtain it.

[0100] Within the `comment` or `comments` attribute element, there is a `comment-list` child node containing a `class` object. This `comment-list` child node contains `div` objects, each of which contains `user`, `text`, `info`, and `reply-box` objects. These represent the user information, comment time, comment content, and sub-comments of this comment, respectively. The `reply-box` object requires recursion to extract the `user`, `text`, and `info` messages from each of its sub-objects.

[0101] Once the div object is located, its content can be filtered using regular expressions to extract the string content. This string content within the div object represents the text portion of the video's comment section.

[0102] In the above process, such as Figure 15 As shown, the controller of the virtual reality device 500 can also be configured to perform the following steps:

[0103] Step S301: Obtain the content corresponding to the target attribute from the content of the target tag.

[0104] The target attribute can be found in the comments or comments section mentioned above. Similarly, the content of the target attribute includes all the content in the video comment section.

[0105] Step S302: Traverse the contents of the target attributes to determine all target objects.

[0106] Specifically, it's necessary to iterate through the content of the target attribute, find the `comment-list` child node of the `class` object, and then filter out the target object from the `comment-list`. The target object can be seen in the `div` object mentioned above.

[0107] If there are several comments related to a video on a webpage, then the comment-list will contain several target objects, and each target object corresponds to one comment. A comment typically contains user information, comment time, comment content, and sub-comment content, and each target object also contains corresponding objects representing user information, comment time, comment content, and sub-comment content.

[0108] Step S303: Extract the string content from each target object and use it as the video's comment content.

[0109] In the target object, the specific comment content is usually in the form of a string. Therefore, in step S303, it is only necessary to extract the target string content in the target object according to the corresponding regular expression to obtain the comment content to be displayed.

[0110] In some embodiments, to enrich the content displayed on the 3D display control 6, the target string content in the target object can be extracted according to the corresponding regular expression in the target correspondence, thereby adding user information to the comment content, allowing users watching the video to clearly understand which user wrote the comment. For example, Figure 16 The 3D display control 6 shown not only displays the specific comment "It all started with the Big Bang", but also displays the username "Zhang San" who posted the comment before the comment content.

[0111] Alternatively, to enrich the content displayed on the 3D display control 6, the target string content can be extracted from the target object based on the corresponding regular expression in the target mapping, thereby increasing the comment time and allowing video viewers to clearly understand when other users wrote the comment. For example, Figure 17 The 3D display control 6 shown not only displays the specific comment content "It all started with the Big Bang" and the username "Zhang San", but also displays the comment time "August 15, 2009" on a new line.

[0112] It is worth noting that in the embodiments of this application, the regular expressions required to extract different string contents, such as user information, comment content, and comment time, are different.

[0113] In the 3D display control 6 of this application embodiment, the comment content can be displayed sequentially according to the posting time of the comment content. Furthermore, the scrolling time interval is preset; for example, if the preset time is 3 seconds, then the 3D display control 6 needs to display the second comment content 3 seconds after displaying the first comment content.

[0114] In some cases, a comment may be too long to be displayed entirely on a single page of the 3D display control 6. For example, the default number of lines for the 3D display control 6 might be 3, but a comment would require 5 lines to display. In such cases, the 3 lines of comment content should be displayed on the 3D display control 6 first, and after a preset time, the remaining two lines should be displayed. It's worth noting that after the preset time, the 3 lines of content displayed initially on the 3D display control 6 will no longer be shown.

[0115] During the process of displaying the comment content as described above, such as Figure 18 As shown, the controller of the virtual reality device 500 can also be configured to perform the following steps:

[0116] Step S401: When the 3D display control 6 is in front of the virtual user interface, determine whether the number of display lines required to display the comment content exceeds the preset number of comment content that can be displayed on the 3D display control 6.

[0117] In step S402, if the number of displayed lines exceeds the preset number of lines, the preset number of lines of the comment content to be displayed will be displayed first on the 3D display control 6.

[0118] Step S403: After a preset time, the remaining content of the comments to be displayed is re-displayed on the 3D display control 6.

[0119] In step S404, if the number of displayed lines does not exceed the preset number of lines, the comment content to be displayed is displayed on the 3D display control 6.

[0120] Step S405: After the next preset time, continue to determine whether the number of display rows required for the next comment content to be displayed exceeds the preset number of comment content that can be displayed on the 3D display control 6.

[0121] In this embodiment, each comment has a corresponding comment time, which refers to the time when the user posted the comment. The comment time can be in the form of a date (year, month, day) or specified down to the hour, minute, and second. The method of representing the comment time is not specifically limited in this embodiment.

[0122] The order in which each comment was posted can be determined by its posting time. The 3D display control usually starts by showing the earliest posted comment.

[0123] In some embodiments, the virtual reality device 500 may also store comments in chronological order of their respective comment times, with the current comment to be displayed being earlier than the next comment to be displayed.

[0124] In some embodiments, when controlling whether the 3D display control 6 is in the foreground or background of the virtual user interface, a Cartesian coordinate system for the control can be established in the rendering scene of the virtual reality device 500, such that the z-axis of the coordinate system is perpendicular to the virtual user interface and extends towards the user. Thus, when the 3D display control 6 is in the foreground of the virtual user interface, its z-axis coordinate can be adjusted to be smaller than the z-axis coordinate of the virtual user interface; and when the 3D display control 6 is in the background of the virtual user interface, its z-axis coordinate can be adjusted to be larger than the z-axis coordinate of the virtual user interface.

[0125] When a user uses the virtual reality device 500 in this embodiment, the virtual reality device 500 can obtain the comment content corresponding to the video when the video is not displayed in full screen. When the video is displayed in full screen, the virtual reality device 500 then displays the comment content separately on another display interface, namely the 3D display control 6. When the video is not displayed in full screen, the 3D display control 6 is at the back of the video display interface, that is, in an invisible state. When the video is displayed in full screen, the 3D display control 6 is at the front of the video display interface, that is, in a visible state. In this way, when the virtual reality device 500 displays the video in full screen, the user can also view the comment content simultaneously, enhancing the immersive experience of watching the video in the 3D scene.

[0126] It is worth noting that the rendering scene in this embodiment refers to a virtual scene constructed by the rendering engine of the virtual reality device 500 through a rendering program. For example, a virtual reality device 500 based on the Unity 3D rendering engine can construct a Unity 3D scene when displaying a screen. Various virtual objects and functional controls can be added to the Unity 3D scene to render specific usage scenarios. For instance, when playing multimedia resources, a display panel can be added to the Unity 3D scene to display the multimedia resource screen. Simultaneously, virtual object models such as seats, speakers, and characters can be added to the Unity 3D scene to create a cinematic effect.

[0127] To address the current issue of users being unable to see related comments when watching videos in full-screen mode on a virtual reality device 500, this application embodiment also provides a video comment display method. This method can be applied to the virtual reality device 500 of the aforementioned embodiment and is specifically implemented by the controller in the virtual reality device 500. The method may include the following steps:

[0128] Step S101: Create a 3D display control 6; the 3D display control 6 is a display interface independent of the virtual user interface.

[0129] Step S102: When the video is not displayed in full screen on the virtual user interface, control the 3D display control 6 to be located behind the virtual user interface, and extract the comment content corresponding to the video on the virtual user interface.

[0130] Step S103: When the video is displayed in full screen on the virtual user interface, control the 3D display control 6 to be in front of the virtual user interface, and display the comment content on the 3D display control 6 in sequence according to the comment time of the comment content.

[0131] The video comment display method provided in this embodiment can establish a 3D display control 6 when the video is not displayed in full screen on the virtual user interface, and control the 3D display control 6 to be located at the back of the virtual user interface. It also extracts the comment content corresponding to the video when the video is not displayed in full screen on the virtual user interface. Then, when the video is displayed in full screen on the virtual user interface, the 3D display control 6 is controlled to be located at the front of the virtual user interface, and the previously extracted comment content is displayed on the 3D display control 6. This allows users to view relevant comment content while watching the full-screen video, enhancing the immersive experience of watching movies in a 3D scene.

[0132] Similar parts between the embodiments provided in this application can be referred to mutually. The specific implementation methods provided above are only a few examples under the overall concept of this application and do not constitute a limitation on the scope of protection of this application. For those skilled in the art, any other implementation methods extended from the solution of this application without creative effort shall fall within the scope of protection of this application.

Claims

1. A virtual reality device, characterized by, The application relates to a display device and a display method thereof. The display device comprises a display configured to display a virtual user interface; and a controller configured to: establish a 3D display control according to a preset width and a preset number of comment contents capable of being displayed; the 3D display control is a display interface independent of the virtual user interface; establish a space rectangular coordinate system, wherein a Z-axis of the space rectangular coordinate system is perpendicular to the virtual user interface; when the virtual user interface displays a video in a non-full screen mode, adjust a Z-axis coordinate of the 3D display control to be greater than a Z-axis coordinate of the virtual user interface, so that the 3D display control is located at a rear end of the virtual user interface and is invisible, and extract at least one comment content corresponding to the video on the virtual user interface; when the virtual user interface displays the video in a full screen mode, adjust the Z-axis coordinate of the 3D display control to be less than the Z-axis coordinate of the virtual user interface, so that the 3D display control is located at a front end of the virtual user interface and is visible, and display the comment contents on the 3D display control according to the preset width and the preset number of comment contents capable of being displayed, in a sequence of comment times of the comment contents, and a preset time interval exists between two adjacent comment contents; when the 3D display control is located at the front end of the virtual user interface, determine whether a display number of to-be-displayed comment contents exceeds the preset number of comment contents capable of being displayed; if the display number of the to-be-displayed comment contents exceeds the preset number of comment contents capable of being displayed, display the preset number of comment contents in the to-be-displayed comment contents on the 3D display control first; after a preset time, redisplay the remaining comment contents in the to-be-displayed comment contents on the 3D display control; after a next preset time, continue to determine whether a display number of next to-be-displayed comment contents exceeds the preset number of comment contents capable of being displayed on the 3D display control; wherein a comment time of the next to-be-displayed comment contents is later than a comment time of a current to-be-displayed comment content. The controller is further configured to:

2. The virtual reality device of claim 1, wherein, determine whether a webpage including a video is completely loaded; if the webpage is completely loaded, acquire a hypertext markup language file of the webpage; extract content of a target tag in the hypertext markup language file; the content of the target tag includes a plurality of attributes corresponding to comment contents of the video; perform layer-by-layer filtering on the content of the target tag to obtain the comment contents of the video. The controller is further configured to:

3. The virtual reality device of claim 2, wherein, acquire content corresponding to a target attribute in the content of the target tag; the content of the target attribute includes all contents in a video comment area; determine all target objects by traversing the content of the target attribute; each target object includes user information, a comment time, a comment content and a sub-comment content; extract string content in each target object as the comment contents of the video. The controller is further configured to:

4. The virtual reality device of any of claims 1-3, wherein, if the display number of the to-be-displayed comment contents does not exceed the preset number of comment contents capable of being displayed, display the to-be-displayed comment contents on the 3D display control; after a preset time, continue to determine whether a display number of next to-be-displayed comment contents exceeds the preset number of comment contents capable of being displayed on the 3D display control. ​ 5. A video comment display method characterized by comprising: The method comprises: establishing a 3D display control according to a preset width and a preset number of lines of comment content that can be displayed; the 3D display control is a display interface independent of a virtual user interface; establishing a space rectangular coordinate system, with a Z-axis of the space rectangular coordinate system being perpendicular to the virtual user interface; when the virtual user interface displays a video in a non-full screen mode, adjusting a Z-axis coordinate of the 3D display control to be greater than a Z-axis coordinate of the virtual user interface, so that the 3D display control is located at a rear end of the virtual user interface and is invisible, and extracting at least one piece of comment content corresponding to the video on the virtual user interface; when the virtual user interface displays the video in a full screen mode, adjusting the Z-axis coordinate of the 3D display control to be less than the Z-axis coordinate of the virtual user interface, so that the 3D display control is located at a front end of the virtual user interface and is visible, and displaying the comment content in sequence according to a comment time of the comment content on the 3D display control according to the preset width and the preset number of lines, with a preset time interval between adjacent two pieces of the comment content; when the 3D display control is located at the front end of the virtual user interface, determining whether a display number of to-be-displayed comment content exceeds the preset number of lines; if the display number exceeds the preset number of lines, displaying the preset number of lines of content in the to-be-displayed comment content on the 3D display control first; after a preset time, redisplaying remaining content of the to-be-displayed comment on the 3D display control; after a next preset time, continuing to determine whether a display number of next to-be-displayed comment content exceeds the preset number of lines of comment content that can be displayed on the 3D display control; wherein a comment time of the next to-be-displayed comment content is later than a comment time of a current to-be-displayed comment content.

6. The method of claim 5, wherein, The step of extracting the comment content corresponding to the video on the virtual user interface comprises: determining whether a webpage including the video is completely loaded; if the webpage is completely loaded, obtaining a hypertext markup language file of the webpage; extracting content of a target tag in the hypertext markup language file; the content of the target tag includes a plurality of attributes corresponding to the comment content of the video; performing layer-by-layer filtering on the content of the target tag to obtain the comment content of the video.

7. The method of claim 6, wherein, The step of performing layer-by-layer filtering on the content of the target tag to obtain the comment content of the video comprises: obtaining content corresponding to a target attribute in the content of the target tag; the content of the target attribute includes all content in a video comment area; traversing the content of the target attribute to determine all target objects; each piece of the target object includes user information, a comment time, comment content and sub-comment content; extracting string content in each of the target objects as the comment content of the video.

8. The method according to any one of claims 5-7, characterized in that, The method further comprises: if the display number does not exceed the preset number of lines, displaying the to-be-displayed comment content on the 3D display control. After a preset time, it is determined whether the number of display lines required for displaying the next comment content exceeds the preset number of display lines of the comment content on the 3D display control.

Images