Immersive experience display system

Abstract

The invention discloses an immersive experience display system, and relates to the field of VR display systems.According to the immersive experience display system, through combination of an image acquisition module and a central processing module, the system can automatically calculate and recommend a recommendation speed TJV suitable for personal characteristics of an experiencer, so that more personalized viewing experience is provided; in this way, the time for adjusting the first-person view angle speed of a video after a user wears the VR head display device is greatly shortened, when most experiencers watch the video after wearing the VR head display device, only the speed of the first-person view angle needs to be slightly adjusted, the user can quickly enter the watching work, then the service life of the adjusting handle, namely the adjusting module, is prolonged, and the user experience is improved. And meanwhile, the probability that poor use experience is brought to later experiencers due to the difference of adaptation of the previous experiencers and the later experiencers to the video speed can be greatly reduced.

Description

Technical Field

[0001] The present invention relates to the field of VR display systems, and in particular to a display system with immersive experience. Background Art

[0002] In local exhibition halls or museums, in order to showcase the local style, drones are usually used to take aerial photos of local geographical features and landscapes, and then the aerial videos are loaded into VR headsets to provide exhibitors with an immersive experience. When a VR headset plays aerial footage, the speed of its first-person perspective can usually be adjusted to simulate the aerial footage of a drone at different speeds. Slow speed is usually suitable for the elderly or people with poor vestibular system sensitivity, while faster speed can be suitable for young and middle-aged people and people with good vestibular system sensitivity and who seek excitement. Based on this, existing VR headsets are usually equipped with an adjustment handle device. While wearing the VR headset to watch, the experiencer can adjust the speed of the first-person perspective of the aerial video by adjusting the handle device to meet his or her own viewing needs. This will cause the following problems: on special dates such as holidays, when there are many exhibitors and many people experiencing VR headsets, each experiencer needs to adjust the VR headset for a long time when wearing it to ensure that the speed meets their viewing needs. This greatly reduces the viewing efficiency and the experience of the exhibitors. At the same time, frequent and large-scale adjustments to the adjustment handle also greatly reduce the service life of the adjustment handle. More importantly, if the previous experiencer adjusts the video speed faster and the next user adapts to the video slower, in this case it is very easy for the next user to have a larger rejection reaction in the body when initially wearing the VR headset, resulting in dizziness, vomiting and other phenomena, thereby reducing the user experience. Summary of the invention

[0003] In order to make up for the deficiencies of the existing technical problems, the purpose of the present invention is to provide an immersive experience display system that can adaptively adjust the first-person perspective speed of the displayed aerial video before the experiencer uses a VR head display device.

[0004] In order to solve the problems of the prior art, the technical solution of the present invention is as follows: A display system with immersive experience, comprising: An image acquisition module is used to collect the appearance image data of the experiencer; VR head-mounted display device, used for users to watch aerial videos from a first-person perspective; An adjustment module, through which the experiencer can adjust the speed of the first-person perspective of the aerial video displayed in the VR head display device; The central processing module calculates a recommended speed TJV that meets the user's needs before the user uses a VR head display device to watch the aerial video, and adjusts the speed preset of the first-person perspective of the aerial video played by the VR head display device to the recommended speed TJV; The storage module is used to store data.

[0005] Preferably, the working steps of the central processing module are as follows: A1. The user uses a VR headset to watch the aerial video from the first-person perspective. The user inputs the speed requirement through the adjustment module. The VR headset adjusts the speed of the aerial video from the first-person perspective based on the input speed requirement, simulating the effect of the speed change of the drone. A2. The central processing module obtains the user's morphological data XT through the appearance image data 目标 , and the playback speed BF obtained by the experiencer 目标 Establish data model x = (BF 目标 , XT 目标 ) is stored in the storage module, and all collected data models x construct a model set X in the storage module; A3. Before the user uses the VR head display device to watch, the central processing module uses the morphological data XT target combined with the model set X to calculate the recommended speed TJV of the user, and controls the VR head display device to play the aerial video at the recommended speed TJV as the speed of the first-person perspective.

[0006] Preferably, the playback speed BF 目标 Use the following steps to obtain: B1. The central processing module records all speeds of the first-person perspective of the aerial video played from the beginning to the end of the experiencer's use of the VR headset device. 记录 , and record aerial video at various speeds 记录 The playback time of SC is as follows; B2. All speeds 记录 Sort the SC values ​​from large to small based on the playback time; B3. Select the first speed in the ranking 记录 Play speed BF for the experiencer 目标 .

[0007] Preferably, the morphological data XT specifically includes age data NL, height data SG, body shape data TT and gender data XB.

[0008] Preferably, the model set X is expressed as: , Among them, x nrepresents the nth data model in the model set X, BF n Indicates the playback speed in the nth data model, XT n Indicates the morphological data in the nth data model, NL n Morphological data XT n Age data in SG n Indicates the shape data XT n Height data in TT n Indicates the shape data XT n Body data in XB n Indicates the shape data XT n Gender data in .

[0009] Preferably, the step A3 specifically comprises the following steps: C1, the central processing module obtains the morphological data XT storage in the data model x in the storage module, calculates the similarity XG between the morphological data XT storage and the morphological data XT target, and traverses all data models x in the model set X; C2, the central processing module arranges all the data models x in the model set X in descending order according to the similarity XG value, and selects the top W data models x in the arrangement; C3. The central processing module obtains the playback speed BF selected by W data models x and calculates the recommended speed TJV through the following formula: ,

[0010] Among them, BF selects i to represent the i-th data model x selected among the W selected data models x 选定 The playback speed in .

[0011] Preferably, the similarity XG is calculated using the following formula: ,

[0012] Among them, NLC represents the age difference between the age data NL storage in the morphological data XT storage and the age data NL target in the morphological data XT target, XS gender represents the gender similarity between the gender data XB storage in the morphological data XT storage and the gender data XB target in the morphological data XT target, XS posture represents the posture similarity between the posture data TT storage in the morphological data XT storage and the posture data TT target in the morphological data XT target, SGC represents the height difference between the height data SG storage in the morphological data XT storage and the height data SG target in the morphological data XT target, a, b, c and d are all weight factors, and a+b+c+d=100%.

[0013] Preferably, it also includes a voice broadcast module.

[0014] Preferably, the working steps of the central processing module also include the following steps: A4. When the user finishes playing the video, the central processing module compares the user's playback speed BF 目标 and recommended speed TJV, at playback speed BF 目标 When the speed is less than the recommended speed TJV, the central processing module calculates the prompt value TS according to the following formula: , 1. Through the combination of the image acquisition module and the central processing module, the system can automatically calculate and recommend the recommended speed TJV that suits the personal characteristics of the experiencer, thereby providing a more personalized viewing experience. This greatly reduces the time it takes for the user to adjust the speed of the first-person perspective of the video after wearing the VR headset. Most experiencers only need to slightly adjust the speed of the first-person perspective to quickly start watching, which in turn increases the service life of the adjustment handle, that is, the adjustment module. At the same time, it can greatly reduce the probability of a poor user experience for later experiencers due to the difference in the video speed adaptation of the previous and subsequent experiencers; 2. By calculating the speed at which the experiencer adapts to the first-person perspective of the aerial video displayed in VR, the difference ratio between the speed of adaptation and the normal adaptation speed, that is, the recommended speed TJV, that is, the prompt value TS, is calculated. In this way, a prompt can be given when the experiencer's adaptation speed is lower than a certain threshold to remind the experiencer that the vestibular system has a poor sensitivity, and to help the experiencer understand and adjust his viewing habits. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 FIG. 1 is a system schematic diagram of Embodiment 1 of the present invention.

[0016] Figure 2 Schematic diagram of method steps of embodiment 1 of the present invention.

[0017] Figure 3 This is a system schematic diagram of Embodiment 2 of the present invention.

[0018] Figure 4 Schematic diagram of method steps of embodiment 2 of the present invention. DETAILED DESCRIPTION

[0019] The technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments.

[0020] For example, see Figure 1 and Figure 2 This embodiment provides an immersive experience display system, including: An image acquisition module is used to collect the appearance image data of the experiencer; VR head-mounted display device, used for users to watch aerial videos from a first-person perspective; An adjustment module, through which the experiencer can adjust the speed of the first-person perspective of the aerial video displayed in the VR head display device; The central processing module calculates a recommended speed TJV that meets the user's needs before the user uses a VR head display device to watch the aerial video, and adjusts the speed preset of the first-person perspective of the aerial video played by the VR head display device to the recommended speed TJV; The storage module is used to store data.

[0021] During the specific use, when the experiencer stands in the experience area, the image acquisition module is specifically a camera that obtains the experiencer's appearance image data and transmits it to the central processing module. The central processing module relies on computer vision and image processing technology and feature extraction technology to obtain morphological data XT from the appearance image data. 目标 ; The working steps of the central processing module are as follows: A1. The user uses a VR headset to watch the aerial video from the first-person perspective. The user inputs the speed requirement through the adjustment module. The VR headset adjusts the speed of the aerial video from the first-person perspective based on the input speed requirement, simulating the effect of the speed change of the drone. A2. The central processing module obtains the user's morphological data XT through the appearance image data 目标 , and the playback speed BF obtained by the experiencer 目标 Establish data model x = (BF 目标 , XT 目标 ) is stored in the storage module, and all the collected data models x construct a model set X in the storage module; the morphological data XT specifically includes age data NL, height data SG, body shape data TT and gender data XB. This process lays the foundation for achieving more accurate personalized recommendations; The model set X expression is: , Among them, x n represents the nth data model in the model set X, BF n Indicates the playback speed in the nth data model, XT n Indicates the morphological data in the nth data model, NL n Morphological data XT n Age data in SG nIndicates the shape data XT n Height data in TT n Indicates the shape data XT n Body data in XB n Indicates the shape data XT n Gender data in The playback speed BF 目标 Use the following steps to obtain: B1. The central processing module records all speeds of the first-person perspective of the aerial video played from the beginning to the end of the experiencer's use of the VR headset device. 记录 , and record aerial video at various speeds 记录 The playback time of SC is as follows; B2. All speeds 记录 Sort the SC values ​​from large to small based on the playback time; B3. Select the first speed in the ranking 记录 Play speed BF for the experiencer 目标 ; A3. Before the user uses the VR head display device to watch, the central processing module uses the morphological data XT target combined with the model set X to calculate the recommended speed TJV of the user, and controls the VR head display device to play the aerial video at the recommended speed TJV as the speed of the first-person perspective; Since the preset adjustment of the first-person perspective speed of the aerial video displayed by the VR avatar device has been completed when the experiencer stands in the experience area, after the experiencer wears the VR head display device, the VR head display device plays the aerial video displayed at the recommended speed TJV. Through personalized recommendation of the recommended speed TJV, the system can help the experiencer quickly find the most suitable playback speed setting for himself, thereby solving the problem of choosing the playback speed, reducing the time for the experiencer to adjust the speed, and at the same time greatly reducing the probability of the subsequent experiencer having a poor user experience due to the difference in the adaptation of the previous and subsequent experiencers to the video speed; The step A3 specifically includes the following steps: C1, the central processing module obtains the morphological data XT storage in the data model x in the storage module, calculates the similarity XG between the morphological data XT storage and the morphological data XT target, and traverses all data models x in the model set X; The similarity XG is calculated using the following formula: , Among them, NLC represents the age difference between the age data NL storage in the morphological data XT storage and the age data NL target in the morphological data XT target, XS gender represents the gender similarity between the gender data XB storage in the morphological data XT storage and the gender data XB target in the morphological data XT target, XS posture represents the posture similarity between the posture data TT storage in the morphological data XT storage and the posture data TT target in the morphological data XT target, SGC represents the height difference between the height data SG storage in the morphological data XT storage and the height data SG target in the morphological data XT target, a, b, c and d are all weight factors, and a+b+c+d=100%; Gender Similarity XS 性别 The judgment principle is: if the gender is the same, the gender similarity is XS 性别 If the gender is different, the gender similarity is XS 性别 is 0; Body similarity XS 体态 The judgment principle is: the body shape data TT includes three types, namely thin body shape, medium body shape and fat body shape. If the body shape is the same, the body shape similarity XS 体态 If the body shape is different, the body shape similarity is XS 体态 is 0.5; C2, the central processing module arranges all the data models x in the model set X in descending order according to the similarity XG value, and selects the top W data models x in the arrangement; C3. The central processing module obtains the playback speed BF selected by W data models x and calculates the recommended speed TJV through the following formula: , Among them, BF selects i to represent the i-th data model x selected among the W selected data models x 选定 The playback speed in .

[0022] The specific application scenarios are as follows: The following is an example of model set X: , Experiencer A stands in the experience area, and the image acquisition module obtains the appearance image data of experiencer A, and the central processing module obtains the morphological data XT 目标 For NL 目标 =21,SG 目标 =175cm, TT 目标 =Medium, XB 目标 =Male; The weight factors a, b, c and d are set to be: a=40%, b=10%, c=20%, d=30%; Calculate morphological data XT 目标 With morphological data XT 1 The similarity XG1 is substituted into the calculation formula of similarity XG as follows: ; Calculate morphological data XT 目标 With morphological data XT 2 The similarity XG2 is substituted into the calculation formula of similarity XG as follows: ; Calculate morphological data XT 目标 With morphological data XT 3 The similarity XG3 is substituted into the calculation formula of similarity XG as follows: ; Calculate morphological data XT 目标 With morphological data XT 4 The similarity XG4 is substituted into the calculation formula of similarity XG as follows: ; According to the obtained similarity XG values, all data models x in the model set X are arranged in descending order to obtain the following arrangement: x2, x4, x3, x1; If W is set to 2, the top two data models x in the ranking are selected, namely x2 and x4. The recommended speed TJV is calculated based on the playback speeds BF of x2 and x4 as follows: , Therefore, the calculated recommended speed TJV is 14m / s, and then the central processing module adjusts the first-person perspective speed of the aerial video played by the VR headset device to 14m / s.

[0023] The following is an example of playback speed BF: The experiencer watched the video for 10 minutes. During the 10 minutes of aerial video viewing, the experiencer watched it at multiple different first-person perspective speeds. The viewing time corresponds to the following Table 1: Table 1. Comparison of viewing time at various first-person perspective speeds <![CDATA[Speed 记录 > Speed ​​record 1 Speed ​​Record 2 Speed ​​Record 3 Speed ​​Record 4 Speed ​​value 5m / s 10m / s 13m / s 15m / s Playing time SC 6 minutes 2.5 minutes 1 minute 0.5 minutes The speeds of multiple different first-person perspectives are sorted from large to small according to the playback duration SC value, and are arranged as 5m / s, 10m / s, 13m / s, and 15m / s. Therefore, the first 5m / s in the arrangement is the experiencer's playback speed BF.

[0024] For example 2, please refer to Figure 3 and Figure 4This embodiment provides a further technical solution based on the first embodiment. An immersive experience display system also includes a voice broadcast module; and also includes the following steps: A4. When the user finishes playing the video, the central processing module compares the user's playback speed BF 目标 and recommended speed TJV, at playback speed BF 目标 When the speed is less than the recommended speed TJV, the central processing module calculates the prompt value TS according to the following formula: , TJV is the recommended speed calculated by the central processing module and BF is the recommended speed for the user. 目标 The central processing unit obtains the playback speed of the user when the user completes the playback of the aerial video; When the prompt value TS is greater than or equal to the set value Q, the central processing controls the voice broadcast module to make a prompt broadcast.

[0025] The specific application scenarios are as follows: The setting value Q is 20%, and the central processing module obtains the user's playback speed BF 目标 The recommended speed TJV calculated by the central processing module is 14 m / s, and the calculated prompt value TS is as follows: ; TS>Q, then when the experiencer finishes playing the video, the central processing module controls the voice broadcast module to issue a prompt to the experiencer to remind the experiencer that his visual adaptation ability and vestibular system sensitivity may be poor.

[0026] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. An immersive experience display system, characterized in that: include: An image acquisition module is used to collect the appearance image data of the experiencer; VR head-mounted display device, used for users to watch aerial videos from a first-person perspective; An adjustment module, through which the experiencer can adjust the speed of the first-person perspective of the aerial video displayed in the VR head display device; The central processing module calculates a recommended speed TJV that meets the user's needs before the user uses a VR head display device to watch the aerial video, and adjusts the speed preset of the first-person perspective of the aerial video played by the VR head display device to the recommended speed TJV; The storage module is used to store data.

2. The immersive experience display system according to claim 1, characterized in that: The working steps of the central processing module are as follows: A1. The user uses a VR headset to watch the aerial video from the first-person perspective. The user inputs the speed requirement through the adjustment module. The VR headset adjusts the speed of the aerial video from the first-person perspective based on the input speed requirement, simulating the effect of the speed change of the drone. A2. The central processing module obtains the user's morphological data XT through the appearance image data 目标 , and the playback speed BF obtained by the experiencer 目标 Establish data model x = (BF 目标 , XT 目标 ) is stored in the storage module, and all collected data models x construct a model set X in the storage module; A3. Before the user uses the VR head display device to watch, the central processing module uses the morphological data XT target combined with the model set X to calculate the recommended speed TJV of the user, and controls the VR head display device to play the aerial video at the recommended speed TJV as the speed of the first-person perspective.

3. The immersive experience display system according to claim 2, characterized in that: The playback speed BF 目标 Use the following steps to obtain: B1. The central processing module records all speeds of the first-person perspective of the aerial video played from the beginning to the end of the experiencer's use of the VR headset device. 记录 , and record aerial video at various speeds 记录 The playback time of SC is as follows; B2. All speeds 记录 Sort the SC values ​​from large to small based on the playback time; B3. Select the first speed in the ranking 记录 Play speed BF for the experiencer 目标 .

4. The immersive experience display system according to claim 3, characterized in that: The morphological data XT specifically includes age data NL, height data SG, body shape data TT and gender data XB.

5. The immersive experience display system according to claim 4, characterized in that: The model set X expression is: ； Among them, x n represents the nth data model in the model set X, BF n Indicates the playback speed in the nth data model, XT n Indicates the morphological data in the nth data model, NL n Morphological data XT n Age data in SG n Indicates the shape data XT n Height data in TT n Indicates the shape data XT n Body data in XB n Indicates the shape data XT n Gender data in .

6. The immersive experience display system according to claim 5, characterized in that: The step A3 specifically includes the following steps: C1, the central processing module obtains the morphological data XT storage in the data model x in the storage module, calculates the similarity XG between the morphological data XT storage and the morphological data XT target, and traverses all data models x in the model set X; C2, the central processing module arranges all the data models x in the model set X in descending order according to the similarity XG value, and selects the top W data models x in the arrangement; C3. The central processing module obtains the playback speed BF selected by W data models x and calculates the recommended speed TJV through the following formula: ； Among them, BF selects i to represent the i-th data model x selected among the W selected data models x 选定 The playback speed in .

7. The immersive experience display system according to claim 6, characterized in that: The similarity XG is calculated using the following formula: ； Among them, NLC represents the age difference between the age data NL storage in the morphological data XT storage and the age data NL target in the morphological data XT target, XS gender represents the gender similarity between the gender data XB storage in the morphological data XT storage and the gender data XB target in the morphological data XT target, XS posture represents the posture similarity between the posture data TT storage in the morphological data XT storage and the posture data TT target in the morphological data XT target, SGC represents the height difference between the height data SG storage in the morphological data XT storage and the height data SG target in the morphological data XT target, a, b, c and d are all weight factors, and a+b+c+d=100%.

8. The immersive experience display system according to claim 7, characterized in that: Also includes a voice broadcast module.

9. The immersive experience display system according to claim 8, characterized in that: The working steps of the central processing module also include the following steps: A4. When the user finishes playing the video, the central processing module compares the user's playback speed BF 目标 and recommended speed TJV, at playback speed BF 目标 When the speed is less than the recommended speed TJV, the central processing module calculates the prompt value TS according to the following formula: ； When the prompt value TS is greater than or equal to the set value Q, the central processing controls the voice broadcast module to make a prompt broadcast.

Images