Scene simulation system, information configuration method, equipment, media and measurement system
By controlling the linkage between the motion device and the display device, and adjusting the temporal relationship between visual and vestibular stimulation, the problem of inaccurate orientation perception in simulated scenarios is solved, thus improving the user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- CENT FOR EXCELLENCE IN BRAIN SCI & INTELLIGENCE TECH CHINESE ACAD OF SCI
- Filing Date
- 2021-01-28
- Publication Date
- 2026-05-26
AI Technical Summary
Existing technologies, while improving user experience, lack coordination with visual and motion perception, resulting in inaccurate sense of direction for users in simulated scenarios.
By controlling the linkage between the motion device and the display device, the first peak speed of the motion device is ensured to occur later than the second peak speed of the animation content by a preset time, thereby adjusting the time relationship between visual and vestibular stimulation to improve the accuracy of the user's directional perception.
It enables more accurate orientation perception in simulated scenarios, thus improving the user experience.
Smart Images

Figure CN114797090B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of smart hardware technology, and in particular to scene simulation systems, information configuration methods, devices, media and measurement systems. Background Technology
[0002] Human-computer interaction experiences based on Virtual Reality (VR) and Augmented Reality (AR) technologies have been widely applied in entertainment, industry, and other fields. Furthermore, visual products (such as smart glasses and smart helmets) are used to provide users with simulated visual experiences. To achieve even more realistic effects, platforms that carry and move users are combined with visual products to create a more lifelike experience. For example, in a roller coaster scenario, the visual product plays a video from the user's perspective on the roller coaster, while the motion platform simulates synchronized ascents, descents, turns, and other movements, thus providing the user with a realistic roller coaster experience.
[0003] However, in order to achieve a better user experience, manufacturers focus on how to improve the realism of display quality and the diversity of motion in motion platforms, but lack research on how to combine visual and motion sensations related to people's real feelings to improve the user experience. Summary of the Invention
[0004] In view of this, the embodiments of this application provide a scene simulation system, information configuration method, device, medium and measurement system to solve the problems in the prior art.
[0005] This application provides a scene simulation system, including: a motion device for carrying an object in motion; a display device for displaying an image to the object; and a control device communicatively connected to the motion device and the display device, for controlling the display device to display animation content and controlling the motion device to perform coordinated movements to form a linkage for simulating a scene; wherein, in each corresponding coordinated action of the linkage, the first peak speed of the motion device occurs later than the second peak speed of the motion change of the animation content by a preset time.
[0006] Optionally, it includes: a motion sensor for detecting motion data of an object; and a control device communicatively connected to the motion sensor, which predicts a first peak motion speed based on the motion data, and controls the motion speed of the motion device so that the actual first peak motion speed occurs later than a preset time after the second peak motion speed of the motion change in the corresponding animation content in the coordinated action.
[0007] Optionally, the preset time is selected from any of the following time periods: 1) 150 ms to 200 ms; 2) 200 ms to 250 ms; 3) 250 ms to 300 ms; 4) 300 ms to 350 ms; 5) 350 ms to 400 ms; 6) 400 ms to 450 ms; 7) 450 ms to 500 ms; 8) 500 ms to 550 ms; 9) 550 ms to 600 ms.
[0008] Optionally, the motion device is a multi-degree-of-freedom motion platform.
[0009] Optionally, the multiple degrees of freedom include one of the following: two degrees of freedom, three degrees of freedom, six degrees of freedom, and nine degrees of freedom.
[0010] Optionally, the display device includes any one of the following: virtual reality glasses or helmet, augmented reality glasses or helmet, display screen or display screen assembly.
[0011] Optionally, the motion device has a limiting device that restricts its relative position to the object's body.
[0012] Optionally, the limiting device is used to restrict at least one of the torso, limbs, and head of the object's body.
[0013] This application provides an information configuration method, including: acquiring animation content; extracting each second motion speed peak based on the animation content; configuring motion configuration information of a motion device; wherein, when the motion configuration information is run, it controls the motion of the motion device to coordinate with the display of the animation content to form a linkage for simulating a scene; in each of the corresponding coordinated actions of the linkage, the first motion speed peak of the motion device occurs later than the second motion speed peak of the motion change of the animation content by a preset time.
[0014] Optionally, the step of extracting each second motion speed peak based on the animation content includes: analyzing the displayed animation content to obtain each second motion speed peak; or, extracting the second motion speed peak based on parameters recorded during the generation of the animation content.
[0015] Optionally, the information configuration method includes: correcting the first motion velocity peak using a prediction model; wherein the prediction model has learned the velocity relationship between the motion device and the head of the object it carries.
[0016] This application provides a computer device, including a memory and a processor. The memory stores executable program code that can run on the processor, wherein the processor executes the information configuration method when running the executable program code.
[0017] This application provides a computer-readable storage medium storing executable program code, wherein the computer instructions are executed by a processor to perform the information configuration method.
[0018] This application provides a scene simulation measurement system, comprising: a motion device for carrying an object and equipped with a motion sensor; a display device for displaying animation content to the object, the animation content including a pattern of moving, equally spaced markers; a sensing device fixedly positioned relative to the display device and pointing to a predetermined position on the display surface of the display device, for detecting markers passing through the predetermined position; a psychophysical data detection system for detecting the psychophysical threshold of the object; and a control device communicatively connected to the motion device, the display device, the motion sensor, and the acquisition device, for controlling the motion of the motion device and / or the display of the display device based on a first peak motion speed of the motion device determined by motion data detected by the motion sensor and a second peak motion speed of the animation content determined by methods such as the density of markers detected by the sensing device, to adjust the sequential relationship between the first peak motion speed of the motion device and the second peak motion speed of the animation content, thereby obtaining corresponding psychophysical data of the subject in the psychophysical data detection system.
[0019] Compared with the prior art, the technical configuration information of the embodiments of this application has the following beneficial effects:
[0020] By controlling the motion device and the display device, the first motion speed peak of the motion device occurs later than the second motion speed peak by a predetermined time, and the acceleration threshold of the vestibular stimulation of the object corresponding to the first motion speed peak is later than the speed peak of the visual stimulation corresponding to the second motion speed peak by a predetermined time. This allows the object to obtain a more accurate sense of direction, thereby improving the accuracy of action in the simulated scene and effectively enhancing the user experience. Attached Figure Description
[0021] Figure 1 A schematic diagram of the scene simulation measurement system in the embodiments of this application is shown.
[0022] Figure 2A The diagram shows a curve illustrating the acceleration data of the motion device in an embodiment of this application.
[0023] Figure 2B This is a schematic diagram showing the speed data of the animation content displayed by the display device in this application embodiment.
[0024] Figure 2C The diagram shows a curve with an interval between the first and second peak motion speeds in a synchronous example.
[0025] Figure 3 The diagram shows the structure of the scene simulation system in this application embodiment.
[0026] Figure 4 The diagram shows a flowchart of the information configuration method in an embodiment of this application.
[0027] Figure 5 The diagram shown is a structural schematic of a computer device according to an embodiment of this application. Detailed Implementation
[0028] In applications such as games and training that simulate real-world scenarios, to achieve a realistic effect, various stimuli, including visual and kinesthetic ones, are used to give users a sense of realism. Specifically, these stimuli include visual and kinesthetic sensory stimulation.
[0029] For example, visually, users can be provided with virtual reality (VR) or augmented reality (AR) headsets or glasses to wear, or a display screen can be provided to play animations of corresponding simulated scenes; in terms of motion perception, the user is placed on a motion platform, which carries the user to move in sync with the animation, thereby giving the user an immersive experience. For example, if the scene in the animation moves to the right, the motion platform may rotate to the left to simulate the user's feeling of turning left.
[0030] Therefore, when extended to more complex simulation scenarios, it can realize scenarios such as roller coasters, racing cars, and shooting.
[0031] Simply improving the quality of the image can indeed bring a more realistic experience to users, but on the one hand, it is costly, and on the other hand, it does not have a significant effect on improving users' sense of direction.
[0032] The body primarily relies on peripheral receptors within three systems—the vestibular system, vision, and proprioception—to sense body position, movement, and external stimuli. Therefore, the applicant of this application explores the impact of the relationship between visual and vestibular stimuli on orientation in scene simulation, aiming to achieve a better user experience through simple and low-cost configuration without requiring further enhancements to animation quality.
[0033] To explore the specific relationship between the two, such as Figure 1 The diagram shows a schematic representation of the scene simulation measurement system provided in this embodiment.
[0034] The scenario simulation measurement system specifically includes: a motion device 101, a motion sensor 102, a sensing device 103, a display device 104, a control device 105, and a psychophysical data detection system (not shown).
[0035] The motion device 101 is used to carry the subject (not shown) in motion. In specific implementations, the motion device 101 can be a motion platform, preferably a multi-degree-of-freedom motion platform, including but not limited to two-degree-of-freedom, three-degree-of-freedom, six-degree-of-freedom, and nine-degree-of-freedom motion platforms. Two degrees of freedom refers to the degree of freedom to rotate, translate, or perform a combination of these movements along the two principal axes X and Y of a planar coordinate system; three degrees of freedom refers to the degree of freedom to rotate, translate, or perform a combination of these movements along the three principal axes X, Y, and Z of a spatial coordinate system; six degrees of freedom is more precise, enabling yaw, pitch, roll, forward / backward, up / down, and left / right movements. Higher degrees of freedom result in fewer restrictions on the achieved motion posture, providing a better simulation experience of the simulated scenario.
[0036] The motion sensor 102 may be one or more acceleration sensors or speed sensors fixedly installed on the motion device 101, used to detect motion data of the motion platform.
[0037] In some examples, the subject may be secured to the relative position between the subject and the motion device 101 by means of, for example, a seatbelt, or a recessed area that conforms to the shape of the subject's body. In possible examples, the subject may be a human or a non-human primate, such as a macaque, that shares many behavioral and cognitive functions with humans.
[0038] Specifically, for subjects whose relative motion device 101 is basically fixed, changes in the speed of the motion platform will be sensed by the subject's vestibular system, thus forming vestibular stimulation for the subject; therefore, the motion data recorded by the motion sensor 102 can reflect the strength of the vestibular stimulation.
[0039] Taking motion sensor 102 as an acceleration sensor (which can be single-axis or multi-axis) as an example, assuming that the motion device 101 is performing, for example, a horizontal translational motion, the motion sensor 102 detects an acceleration to deceleration process, such as... Figure 2A As shown in the figure, a waveform diagram of acceleration data on a single axis of the accelerometer detected during this process is illustrated. From the figure, it can be seen that at time t... ves,peak When the acceleration changes from a positive value to 0, it indicates that the motion speed no longer increases, and the motion speed has reached its peak value, which is defined as the first motion peak value in this application.
[0040] It is understood that the motion sensor 102 can also be implemented as a speed sensor. Since the relationship between speed and acceleration can be converted, it is not limited to the implementation of an acceleration sensor.
[0041] The display device 104 is used to display animation content to the subject. In specific implementations, the display device 104 may include one or more displays, such as a single flat or curved display, or a combination or splicing of multiple displays. Optionally, to facilitate accurate detection by the sensing device 103, a single flat display is preferred.
[0042] To facilitate simple and real-time detection of the speed of change of the animation in the display device 104, the animation content includes a pattern of moving, equally spaced markers 141. Correspondingly, the sensing device 103 is fixedly positioned relative to the display device 104 and points to a predetermined position on the display surface of the display device 104, for detecting each marker 141 passing through the predetermined position.
[0043] For example, the pattern displayed in the display device 104 may be a grating pattern, the mark 141 being each bright part of the grating (the area between the bright parts is a dark part), the grating pattern may be translated in one or more directions, and the sensing device 103 may be a single-point photoelectric sensor used to generate a corresponding signal change, such as a pulse, when each pair of parts in the grating pattern passes through its sensing area.
[0044] like Figure 2B As shown, a waveform diagram of motion data of the animation content (i.e., raster pattern) displayed by the display device 104 detected by the light sensor 103 is provided as an example. Figure 2B The animation content in the embodiment can be related to Figure 2A In this embodiment, the movement of the motion platform is synchronized; that is, when the motion platform moves horizontally, the grating pattern also moves horizontally during its translation time. It can be understood that the faster the grating pattern moves, the faster the grating passes through the photosensor 103, and the more concentrated the pulses generated. Therefore, t in the figure... vis,peak The pulses at the corresponding moment are the most concentrated, and the peak motion speed of the displayed animation content is defined as the second motion peak.
[0045] The control device 105 is communicatively connected to the motion device 101, the display device 104, the motion sensor 102, and the acquisition device. It is used to control the movement of the motion device 101 and / or the display of the display device 104 based on the first peak value of the motion speed of the motion device 101 determined by the motion data detected by the motion sensor 102 and the second peak value of the animation content determined by the density of the sequential markers 141 detected by the sensing device 103, so as to adjust the sequential relationship between the first peak value of the motion speed of the motion device 101 and the second peak value of the motion change of the animation content.
[0046] In a specific implementation, the control device 105 may be a server, desktop computer, laptop computer, smartphone, tablet computer, etc., which sends instructions to the motion device 101 and the display device 104 to adjust the relationship between the first peak speed and the second peak speed.
[0047] For example, the playback time of the animation content can be advanced, or the motion time of the motion platform can be delayed, so that the second motion speed peak occurs before the first motion speed peak; conversely, the first motion speed peak can occur before the second motion speed peak.
[0048] For example, such as Figure 2C As shown, the demonstration will Figure 2A and Figure 2B The waveform diagram in the image is combined with the waveform illustration, where t vis,peak Located at t ves,peak Previously, the time difference between the two was △T.
[0049] The aforementioned psychophysical data detection system is used to detect the subject's first corresponding psychophysical data in order to study t vis,peak and t ves,peak The impact of the order of events on the test subjects; t vis,peak and t ves,peak The sequence of events essentially refers to the order in which vestibular and visual stimuli are applied to the subject. In practice, the psychophysical data may include a psychophysical threshold that reflects the relationship between the subject's physical stimulation and sensory perception (psychological).
[0050] In practice, the measurement method of the psychophysical threshold can refer to existing psychophysical knowledge, such as the limit method, adjustment method and constant stimulus method.
[0051] In practice, participants' behavioral output can often be replaced by eye movements or manual actions (such as a game controller) instead of verbal reports. This method can accurately and promptly reflect the participant's cognitive decision-making in a binary choice task, and is therefore widely used in psychophysical experiments on humans and non-human primates. In an optional embodiment, based on the negative correlation between the psychophysical threshold and the accuracy of orientation perception, data on the accuracy of primates' orientation judgment can be obtained by observing the primates' decision-making behavior (e.g., eye movement orientation) during the experiment using the aforementioned scenario simulation measurement system. This data can then be used to fit a psychometric function, such as using a cumulative Gaussian distribution function (CDF). Further optionally, once the psychometric function is determined, the standard deviation (e.g., the standard deviation σ of the cumulative distribution function) can be calculated based on the psychometric function. For example, corresponding to an 84% accuracy rate, this standard deviation can be defined as the psychophysical threshold.
[0052] In a specific experimental example, based on the environment of the aforementioned measurement system, by measuring at t... vis,peak Leading t ves,peak In the experimental data under these conditions, data with a lead time of 250 milliseconds, 500 milliseconds, and 750 milliseconds were selected, and the data were analyzed at t... vis,peak and t ves,peak The difference is 0, and at t vis,peak Delay t ves,peak The experimental data obtained under the selected conditions, such as a delay of 250 milliseconds, are shown in the table below:
[0053] <![CDATA[t vis,peak -t ves,peak ]]> Psychophysical threshold Average accuracy ...... ...... ...... -250 milliseconds 2.42 80.6% 0 2.37 85.0% 250 milliseconds 1.61 86.3% 500 milliseconds 1.53 87.5% 750 milliseconds 2.34 85.6% ...... ...... ......
[0054] The above experiment, extracting only a portion of the dense data, reveals that t vis,peak Leading t ves,peak Compared to t vis,peak Delayed by t ves,peak The psychophysical threshold is reduced, especially when it is 500 milliseconds ahead, corresponding to the best accuracy of 87.5%. It can be seen that the second motion speed peak of the animation content displayed by the display device 104 occurs before the first motion speed peak of the motion device 101. Even if the visual stimulus is applied before the vestibular stimulus, it is beneficial to reduce the psychophysical threshold of the object, thereby having a more accurate sense of direction and a better scene simulation experience.
[0055] Furthermore, the longer the lead time between the second peak velocity and the first peak velocity is, the better is not necessarily true. This can be seen in t... vis,peak Leading t ves,peak When the time reached 750ms, the subjects' sense of direction was not accurate, indicating that their psychophysical threshold began to rise again.
[0056] Therefore, based on the above process, it can be concluded that when the motion device 101 and the display device 104 are linked, in each corresponding coordinated action, such as a leftward movement of the motion device 101 coordinated with a rightward turn or rightward movement in the animation content displayed by the display device 104, if the first motion speed peak is delayed by a preset time of the second motion speed peak, it will help improve the sense of direction of the object, thereby improving the simulated scene experience.
[0057] Based on the above experimental data, a preset time interval can be obtained for the first peak velocity to lag behind the second peak velocity, so as to generate a better sense of direction and corresponding accuracy for the subject. This time interval can be selected from any of the following: 1) 150 ms to 200 ms; 2) 200 ms to 250 ms; 3) 250 ms to 300 ms; 4) 300 ms to 350 ms; 5) 350 ms to 400 ms; 6) 400 ms to 450 ms; 7) 450 ms to 500 ms; 8) 500 ms to 550 ms; 9) 550 ms to 600 ms.
[0058] like Figure 3 The diagram shown illustrates the structure of the scene simulation system in this embodiment of the application.
[0059] The scene simulation system includes a motion device 301, a display device 302, and a control device 303.
[0060] The motion device 301 is used to move an object (such as a user). In specific implementations, the motion device 301 can be a motion platform, preferably a multi-degree-of-freedom motion platform, such as three-degree-of-freedom, six-degree-of-freedom, or nine-degree-of-freedom motion platform.
[0061] To ensure a good experience by fixing the relative position between the object and the motion device 301, in an optional example, the motion device 301 may have a limiting device (not shown) that restricts its relative position to the object's body, such as at least one of the following: a seat belt, a limiting space (seat), etc., that restricts the torso of the object's body; a loop or seat belt that may be provided for the limbs; a head recess or headrest that corresponds to the head or a neck recess or headrest, etc.
[0062] The display device 302 is used to display an image to the object. In possible examples, the display device 302 includes any of the following: virtual reality glasses or helmets, augmented reality glasses or helmets, a display screen or a display screen assembly, etc. The figure exemplarily shows the display device as virtual display or augmented reality glasses.
[0063] For example, an object can sit on the motion device 301 and wear virtual reality glasses, augmented reality glasses, or a helmet. Animations are displayed on the helmet or glasses, and the motion device 301 moves accordingly. In particular, virtual reality glasses or helmets can simulate a wider range of scenes, not limited to real-world scenarios, but also including virtual scenes such as fantasy, Western fantasy, and science fiction. Furthermore, virtual reality helmets are also called immersive helmets, used to create immersive virtual reality environments; typical devices include Oculus Rift, HTC Vive, and Baofeng Mojing. Augmented reality helmets are also called transmissive helmets; typical examples include HoloLens and Magic Leap.
[0064] For example, in a racing scene, a single or multiple display screens can be used to display images related to the racing scene.
[0065] The display screen used can be an LCD, LED, or OLED display, and can be curved or flat, with its size varying according to actual needs. In multi-view application scenarios, it can also be achieved through a group of display screens. For example, multiple display screens can be arranged at different angles. For instance, a first display screen can be placed directly in front of the object's seat of the motion device 301, a second display screen can be placed at a 15-30 degree angle to the left of the first display screen, and a third display screen can be placed at a 15-30 degree angle to the left of the first display screen. The display surfaces of the first, second, and third display screens all face the object's seat of the motion device 301, and the images are displayed synchronously according to the object's viewing angle corresponding to their respective positions, achieving a widescreen effect. Of course, in other examples, one or more curved screens of a larger size can be used instead, and this implementation method is not limited to this one.
[0066] The control device 303 is communicatively connected to the motion device 301 and the display device 302, and is used to control the display device 302 to display animation content and control the motion device 301 to perform coordinated movements to form a linkage for simulating a scene; wherein, in each corresponding coordinated action of the linkage, the first peak of the motion speed of the motion device 301 occurs later than the second peak of the motion speed of the motion change of the animation content by a preset time.
[0067] Referring to previous experimental embodiments, the preset time can be selected from any of the following time periods: 1) 150 ms to 200 ms; 2) 200 ms to 250 ms; 3) 250 ms to 300 ms; 4) 300 ms to 350 ms; 5) 350 ms to 400 ms; 6) 400 ms to 450 ms; 7) 450 ms to 500 ms; 8) 500 ms to 550 ms; 9) 550 ms to 600 ms. This allows the object to have a lower psychophysical threshold, maintain a better sense of direction, and thus have a better object experience.
[0068] In some examples, the control device 303 can be implemented as a standalone electronic device, such as a server, computer, laptop, smartphone, tablet, etc., and communicate with the motion device 301 and display device 302 via a wired or wireless interface. In other examples, the control device 303 can also be a control component integrated into the motion device 301 or display device 302, such as a controller.
[0069] In some examples, the scene simulation system may include a motion sensor (not shown) for detecting motion data of an object; optionally, the motion sensor may be located in the motion device 301 or in the helmet or glasses worn by the object; generally, VR or AR helmets and glasses integrate an accelerometer, which can serve as the motion sensor. The control device 303 is communicatively connected to the motion sensor, predicts a first peak motion speed based on the motion data, and controls the motion speed of the motion device 301 so that the actual first peak motion speed occurs later than a preset time after the second peak motion speed corresponding to the motion change of the animation content in the action. In possible examples, if the display device 302 worn by the object is a VR or AR helmet or glasses, the control device 303 may connect to the VR or AR helmet or glasses via a data cable or wireless communication (e.g., Bluetooth, WiFi, etc.) to exchange data, such as sending a start command to the VR or AR helmet or glasses, receiving motion data collected by the motion sensor, etc.
[0070] In this example, motion data of the object is actively acquired via a motion sensor. The control device 303 obtains a first peak motion speed based on this data. By controlling the speed of the motion device 301, the predicted first peak motion speed occurs later than a preset time before the second peak motion speed occurs. This approach is suitable for scenarios where there is active human interaction with the object, such as shooting games. Of course, when the object actively interacts, the control device 303 can also determine its orientation based on the acceleration data that may be included in the object's motion data, thereby changing the displayed animation content.
[0071] In other examples, objects can also be passively experienced, such as in VR movies or roller coasters. Therefore, the motion configuration information of the motion device 301 can be pre-configured for the animation content of the simulated scene, and the control device 303 only needs to activate the display device 302 and the motion device 301 to ensure that the first motion speed peak in each coordinated action occurs later than the second motion speed peak by a preset time.
[0072] Correspondingly, such as Figure 4 The diagram shown illustrates a flowchart of the information configuration method provided in this embodiment. The information configuration method specifically includes:
[0073] Each second motion speed peak is extracted based on the animation content, such that in each of the corresponding coordinated actions, the first motion speed peak of the motion device occurs later than the second motion speed peak of the motion change in the animation content by a preset time.
[0074] In some examples, such as Figure 4 As shown, the step of extracting each second motion speed peak based on the animation content includes:
[0075] Step S401: Obtain animation content.
[0076] In some examples, the animation content can be existing or generated. The animation content can be video, cartoon, etc.
[0077] Step S402: Extract the peak value of each second motion speed based on the animation content.
[0078] In some examples, when the animation content is available but the relevant parameters at the time of its design are unknown, making it impossible to obtain the first peak motion velocity, the displayed animation content can be analyzed to obtain each second peak motion velocity, for example, by analyzing it using the motion analysis method of optical flow field.
[0079] In other examples, the second peak motion speed can be extracted from parameters recorded during the animation content generation process. For instance, in live-action video, the camera's acceleration value can be obtained and recorded using an accelerometer to extract the second peak motion speed; for animated films, producers can record animation design parameters during the animation design phase, from which they can obtain speed data of motion changes and then extract the second peak motion speed.
[0080] Step S403: Configure the motion configuration information of the motion device.
[0081] The motion configuration information controls the motion of the motion device to coordinate with the display of the animation content during runtime to form a linkage for simulating the scene; in each corresponding coordinated action of the linkage, the first peak motion speed of the motion device occurs later than the second peak motion speed of the animation content by a preset time.
[0082] Optionally, the first peak motion speed occurs later than the second peak motion speed by a preset time, wherein the preset time is selected from any one of the following time periods: 1) 150 ms to 200 ms; 2) 200 ms to 250 ms; 3) 250 ms to 300 ms; 4) 300 ms to 350 ms; 5) 350 ms to 400 ms; 6) 400 ms to 450 ms; 7) 450 ms to 500 ms; 8) 500 ms to 550 ms; 9) 550 ms to 600 ms.
[0083] In some examples, the motion configuration information may include a motion control scheme for implementing the animation content, which may include a combination of instructions for controlling the motion device, such as controlling the rotation of each motor that enables the motion platform to move in each degree of freedom. The motion configuration information of the motion device may be stored in the motion platform, and the motion control scheme in the motion configuration information can be invoked simply by the control device sending the corresponding start command.
[0084] In practical applications, considering that the head of an object may move relative to the body when wearing display devices such as glasses or helmets, there will be a certain difference between the first peak velocity of the motion device and the actual first peak velocity of the object's head. Therefore, in some examples, the first peak velocity can be corrected by a predictive model; wherein the predictive model has learned the velocity relationship between the motion device and the head of the object it carries.
[0085] In a possible example, when the original first motion speed peak of the motion device is input to the prediction model, a predicted first motion speed peak is obtained. The predicted first motion speed peak is used as a correction result of the original first motion speed peak for use when configuring the above motion configuration information.
[0086] The scene simulation system in this application embodiment can have a variety of practical commercial applications.
[0087] For example, virtual reality movies. In practical implementation, the above information configuration method is executed to obtain each second motion speed peak in the movie scene to be played, and a motion platform is set up in the audience area. The motion configuration information of the motion platform is pre-configured so that during actual movie playback in the scene simulation system, the motion of the motion platform follows the changes in the movie scene, and each first motion speed peak of the motion platform occurs later than each second motion speed peak by a preset time. This can help moviegoers obtain a more acute motion perception experience within limited motion.
[0088] For example, in passive virtual reality games, such as roller coasters and sightseeing games, the motion configuration information of the motion platform is pre-set according to the game video. This allows the motion platform to follow the changes in the game video screen during actual movie playback in the scene simulation system. Furthermore, each first motion speed peak of the motion platform occurs later than each second motion speed peak by a preset time, which can help virtual reality gamers obtain a more acute motion perception experience within limited movement.
[0089] For example, user-initiated virtual reality games. In games such as shooting games and racing games, the user's motion data can be collected in real time to predict the first peak motion speed. The motion platform can then be controlled to slow down the motion so that the first peak motion speed occurs later than the second peak motion speed of the game animation, thus enhancing the user's motion perception (such as sense of direction) and increasing the chances of winning the game.
[0090] like Figure 5 The diagram shown illustrates the structure of a computer device in an embodiment of this application.
[0091] The computer device 500 includes a memory 501 and a processor 502. The memory 501 stores a computer program that can run on the processor 502. When the processor 502 runs the computer program, it performs the aforementioned, for example... Figure 4 The steps in the information configuration method in the embodiment can also realize the functions of the control devices 105 and 303 in the above embodiment.
[0092] In some examples, the processor 502 may be a combination of computing functions, such as a combination of one or more microprocessors, digital signal processing (DSP), ASIC, etc.; the memory 501 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk storage.
[0093] In some examples, the computer device 500 may also include a communicator 503 for communicating with external devices. In possible implementations, the communicator 503 may include one or more of, for example, a USB module, a wired network card, a wireless network card, a Bluetooth module, and a 2G / 3G / 4G / 5G module.
[0094] In some examples, the computer device 500 may be implemented as, for example, a server, server group, desktop computer, laptop computer, smartphone, tablet computer, smart bracelet, smartwatch, or other smart device, or a processing system formed by communication connections of these smart devices.
[0095] This application embodiment may also provide a computer-readable storage medium storing a computer program, wherein the computer program, when executed, performs the aforementioned, for example... Figure 4 The method steps in the embodiments.
[0096] That is, embodiments of this application (e.g.) Figure 4 The method flow in the embodiments can be implemented as software or computer code that can be stored in a recording medium (such as CD-ROM, RAM, floppy disk, hard disk, or magneto-optical disk), or as computer code that is originally stored in a remote recording medium or a non-transitory machine-readable medium and will be stored in a local recording medium after being downloaded via a network. Thus, the method described herein can be stored as software processing on a recording medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware (such as ASIC or FPGA). It is understood that the computer, processor, microprocessor controller, or programmable hardware includes storage components (e.g., RAM, ROM, flash memory, etc.) capable of storing or receiving software or computer code, which, when accessed and executed by the computer, processor, or hardware, implements the methods described in the foregoing embodiments (e.g., ...). Figure 4 In the method of the embodiment), furthermore, when a general-purpose computer accesses the code used to implement the method shown herein, the execution of the code transforms the general-purpose computer into a dedicated computer for executing the steps of the method shown herein.
[0097] Compared with the prior art, the technical configuration information of the embodiments of this application has the following beneficial effects:
[0098] By controlling the motion device and the display device, the first peak speed of the motion device occurs later than the second peak speed by a predetermined time. This causes the acceleration threshold of the user's vestibular stimulation corresponding to the first peak speed to be later than the speed peak of the visual stimulation corresponding to the second peak speed by a predetermined time. This allows the user to obtain a more accurate sense of direction, thereby improving the accuracy of actions in the simulated scenario and effectively enhancing the user experience.
[0099] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. A computer program product includes one or more computer programs. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions according to this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer program can be stored in a computer-readable storage medium or transferred from one computer-readable storage medium to another.
[0100] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of this application. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of those different embodiments or examples.
[0101] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this application, "a plurality of" means two or more, unless otherwise explicitly specified.
[0102] Any process or method description in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or more executable instructions for implementing a particular logical function or process. Furthermore, the scope of the preferred embodiments of this application includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functionality involved.
[0103] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus or device (such as a computer-based system, a processor-included system or other system that can fetch and execute instructions from, an instruction execution system, apparatus or device).
[0104] For example, the aforementioned Figure 4The order of the steps in the embodiments may vary in specific scenarios and is not limited to the above description.
[0105] While the embodiments disclosed above are provided in this application, the present invention is not limited thereto. Any person skilled in the art can make various modifications and alterations without departing from the spirit and scope of the embodiments of this application; therefore, the scope of protection of the present invention should be determined by the scope defined in the claims.
Claims
1. A scenario simulation system, characterized by, include: A motion device used to move an object; A display device for displaying an image on the object; A control device, communicatively connected to the motion device and the display device, is used to control the display device to display animation content and to control the motion device to perform coordinated movements to form a linkage for simulating a scene. In each corresponding coordinated action of the linkage, the first peak speed of the motion device occurs later than the second peak speed of the animation content by a preset time. The first peak speed corresponds to the vestibular acceleration threshold of the object, i.e., the acceleration changes from a positive value to 0, and the speed reaches its peak. The second peak speed corresponds to the peak speed of the visual stimulus. The preset time is selected from any one of the following time periods: 1) 150 ms to 200 ms; 2) 200 ms to 250 ms; 3) 250 ms to 300 ms; 4) 300 ms to 350 ms; 5) 350 ms to 400 ms; 6) 400 ms to 450 ms; 7) 450 ms to 500 ms; 8) 500 ms to 550 ms; 9) 550 ms to 600 ms. A motion sensor, wherein the motion sensor is an accelerometer, and the motion sensor is used to detect motion data of an object; By controlling the motion device and the display device, the first motion speed peak of the motion device occurs later than the second motion speed peak by a predetermined time, and the acceleration threshold of the vestibular stimulation of the object corresponding to the first motion speed peak occurs later than the speed peak of the visual stimulation corresponding to the second motion speed peak by a predetermined time.
2. The scenario simulation system according to claim 1, characterized by include: The control device is communicatively connected to the motion sensor. Based on the motion data, it predicts a first peak motion speed and controls the motion speed of the motion device so that the actual first peak motion speed occurs later than a preset time after the second peak motion speed of the motion change in the corresponding animation content.
3. The scenario simulation system of claim 1, wherein The display device includes any one of the following: virtual reality glasses or helmet, augmented reality glasses or helmet, display screen or display screen assembly.
4. An information configuration method characterized by comprising: include: Get animation content; Extract the peak value of each second motion velocity based on the animation content; Configure motion configuration information for the motion device; wherein, when the motion configuration information is run, it controls the motion of the motion device to coordinate with the display of the animation content to form a linkage for simulating a scene; in each corresponding coordinated action of the linkage, the first motion speed peak of the motion device occurs later than the second motion speed peak of the motion change of the animation content by a preset time, such that the acceleration threshold value of the vestibular stimulation of the object corresponding to the first motion speed peak value is later than the speed peak value of the visual stimulation corresponding to the second motion speed peak value by a predetermined time, wherein the acceleration threshold value refers to the acceleration changing from a positive value to 0, and the speed reaching the peak value; The first peak motion velocity is predicted by motion data of the object detected by a motion sensor, wherein the motion sensor is an accelerometer, and the preset time is selected from any one of the following time periods: 1) 150 ms to 200 ms; 2) 200 ms to 250 ms; 3) 250 ms to 300 ms; 4) 300 ms to 350 ms; 5) 350 ms to 400 ms; 6) 400 ms to 450 ms; 7) 450 ms to 500 ms; 8) 500 ms to 550 ms; 9) 550 ms to 600 ms.
5. The information configuration method according to claim 4, characterized in that, The step of extracting each second motion speed peak based on the animation content includes: Analyze the displayed animation content to obtain each second motion speed peak; or, extract the second motion speed peak based on the parameters recorded during the generation of the animation content.
6. The information configuration method according to claim 4, characterized in that, include: The first peak motion velocity is corrected by a predictive model; wherein the predictive model has learned the velocity relationship between the motion device and the head of the object it carries.
7. A computer device, characterized in that, include: A memory and a processor, wherein the memory stores executable program code that can run on the processor, wherein the processor executes the information configuration method according to any one of claims 4 to 6 when running the executable program code.
8. A computer-readable storage medium, characterized in that, The system stores executable program code, wherein the computer instructions are executed by a processor to perform the information configuration method as described in any one of claims 4 to 6.
9. A scene simulation measurement system, characterized in that, include: A motion device, used to move the subject, is equipped with motion sensors; A display device for displaying animated content to the object, the animated content including: a pattern of moving, equally spaced markers; A sensing device is fixedly disposed relative to the display device and pointed to a predetermined position on the display surface of the display device, for detecting each mark passing through the predetermined position; A psychophysical data detection system is used to detect the psychophysical data of test subjects. A control device, communicatively connected to the motion device, display device, motion sensor, and acquisition device, is used to control the movement of the motion device and / or the display of the display device based on the first peak speed of the motion device determined by the motion data detected by the motion sensor, and the second peak speed of the animation content determined by the density of the sequential markers detected by the sensor, so as to adjust the sequential relationship between the first peak speed of the motion device and the second peak speed of the motion change of the animation content, and obtain the corresponding psychophysical data of the subject in the psychophysical data detection system. The motion sensor is an accelerometer; by controlling the motion device and the display device, the first motion speed peak of the motion device occurs later than the second motion speed peak by a predetermined time, and the acceleration threshold value of the vestibular stimulation of the object corresponding to the first motion speed peak is later than the speed peak value of the visual stimulation corresponding to the second motion speed peak by a predetermined time, wherein the acceleration threshold value refers to the acceleration changing from a positive value to 0, and the speed reaching the peak value; The preset time is selected from any one of the following time periods: 1) 150 ms to 200 ms; 2) 200 ms to 250 ms; 3) 250 ms to 300 ms; 4) 300 ms to 350 ms; 5) 350 ms to 400 ms; 6) 400 ms to 450 ms; 7) 450 ms to 500 ms; 8) 500 ms to 550 ms; 9) 550 ms to 600 ms.