174results about How to "Improve the immersive experience" patented technology

This disclosure describes a head-mounted display with a display assembly configured to display content to most or all of a user's field of view. The display assembly can be configured to display content in far-peripheral regions of the user's field of view differently than content upon which a user can focus. For example, spatial resolution, color resolution, refresh rate and intensity (i.e. brightness) can be adjusted to save resources and / or to bring attention to virtual content positioned within a far-peripheral region. In some embodiments, these changes can save processing resources without detracting from the user's overall experience.

The invention discloses a motor matrix control method and wearable equipment. The method comprises the following steps: on the basis of a three-dimensional spherical model, installing a plurality of linear motors to form a linear motor matrix and determining directions of all the linear motors of the linear motor matrix on the three-dimensional spherical model; carrying out information extraction on a received three-dimensional audio signal and acquiring the direction, frequency and amplitude information of the three-dimensional audio signal after reaching a center position of the three-dimensional spherical model; and generating a motor driving signal according to the direction, frequency and amplitude information of the three-dimensional audio signal after reaching the center position of the three-dimensional spherical model, and driving linear motors, a certain distance away from the direction of the three-dimensional audio signal, in the linear motor matrix to vibrate. With the adoption of the technical scheme provided by the invention, by inputting the direction, amplitude and frequency components in the three-dimensional sound to the tactile feedback three-dimensional matrix motor, and the real sense experience is enhanced from the touch sense, so that seamless coordination of the sound and tactile feedback is realized and the immersive experience of virtual reality is better.

A method for transferring knowledge including the steps of organizing an author's source documents including presentation and reference material into units of presentation and units of reference, establishing one or more sets of rules of presentation of the units, defining one or more components of presentation, preparing one or more sequences of presentation of the units, storing the units of presentation, units of reference, sequences of presentation, component definitions, and sets of rules in a knowledge database on a source computing system, and generating, based on the sets of rules, a collection of interlinked browser-ready electronic document pages.

The invention discloses an unmanned mine card remote control driving system and method, and belongs to the technical field of engineering vehicle unmanned drivers. The method includes the steps that during work, a vehicle end sends vehicle data and external environment data to a driving simulator; a human-computer interaction interface displays vehicle data of the vehicle to be taken over, vehicleexternal environment data and a vehicle taking-over request prompt window; after a driving simulator receives a takeover request or actively requests to take over the vehicle, data synchronization before takeover of the vehicle is carried out, and after data synchronization is completed, remote control driving can be carried out, wherein the data synchronization comprises vehicle own data and vehicle external environment data. The system and method are higher in actual experience and reliability, the steering wheel at the simulator end can be synchronized with the current steering wheel of the vehicle before takeover, it is ensured that takeover is conducted instantly and stably, and takeover is safe. The system and method are based on 4G communication, are not limited by distance, and are based on 5G communication in an erected 5G test area, so that the stability of the whole system is improved.

The invention discloses an interactive shoot cinema imitation gun system with a recoil feedback system and a method. After an imitation gun is electrified, an imitation gun communication module is automatically connected with a server communication module; acquired data is calculated by a gyroscope module to obtain relative displacement of a current muzzle and transmit to a controller; the acquired data is calculated by an acceleration sensor module to obtain a message whether a user makes a gun aiming operation and a result is transmitted to the controller; whether a trigger is pulled to shoot is detected; recoil is provided by the recoil feedback module after the trigger is pulled; shoot sound and bullet casing falling sound are emitted by a sound effect module; light is emitted by a light effect module to imitate light of the muzzle; the data acquired by the gyroscope module and the acceleration sensor module, an imitation gun ID (Identity) and a trigger state are received by the controller and are packaged and transmitted to a server; the data transmitted by the imitation gun is received by the server to perform corresponding processing. The recoil of single shot and automatic firing of the imitation gun can be imitated, so the amusement is enhanced.

A display apparatus may include: a display panel including: a display area configured to display an image, and a non-display area, an optical module on a rear surface of the display panel, at least one first sound generator on a rear surface of the optical module, and at least one second sound generator in the non-display area and between the display panel and the optical module.

The invention provides a streaming media generation method and device based on a virtual character; the method comprises the steps: configuring a first virtual character generation assembly in a first application program; acquiring real-time user physical sign data provided by a camera of equipment where a first application program is located through the first virtual character generation component; regulating, by a first virtual character generation component, the preset first virtual character model data in real time according to the real-time user sign data; and according to the first virtual character model data and the virtual scene data which are adjusted in real time, rendering and generating a virtual scene streaming media containing a virtual character image corresponding to the target user. Through the method and the device, the technical problem that the virtual character cannot be synchronously displayed through the physical sign data of the user in the real scene in the prior art is solved, and the man-machine interaction efficiency is improved.

The invention discloses a dynamic space virtual sound processing system and method in a VR TV. The processing system includes a VR TV remote controller, a first processor, a calling module and a second processor. The first processor calculates the head orientation angle information of the user according to the reference coordinates, the orientation change instruction information and the setting angle of the virtual speaker. The calling module reads the head azimuth angle information and the setting angle of the virtual speaker to obtain the relative azimuth angle between the head and the virtual speaker; calls out the transfer function corresponding to the relative azimuth angle from the head-related transfer function database or matches to the closest one The transfer function corresponding to a relative azimuth angle in the head-related transfer function database. The second processor convolves the input signal according to the transfer function to generate the first channel signal and the second channel signal. The present invention outputs the corresponding audio signal according to the moving position of the audience user, thereby helping to improve the immersive experience of the audience user.

An embodiment of the invention provides a control method and device for virtual object jumping. The control method includes: providing a jumping controller on a graphical user interface; when a sliding touch operation acting on the jumping controller is detected, controlling a virtual object to jump and controlling jumping postures of the virtual object according to the sliding direction of the sliding touch operation. Since jumping and jumping postures of the virtual object are controlled by the sliding touch operation acting on the jumper controller, the problem that the graphical user interface is occupied by too many buttons is solved, the area occupied by the buttons in the graphical user interface is reduced, and immersive experience of games is improved; on the other hand, the problem that the user needs to click multiple control buttons in a short time is solved, user operation is simplified, learning cost and operation cost of the user are reduced, and user experience is improved.

The embodiment of the invention relates to the technical field of electronics, and discloses a mobile terminal and a sound effect control method. In the embodiment of the invention, a processor, a screen and at least one pair of sound effect loudspeakers are provided, in the pair of sound effect loudspeakers, the sound outlet hole of one sound effect loudspeaker is located in one side edge of thescreen, the sound outlet hole of the other sound effect loudspeaker is located in the other side edge of the screen, and the two side edges are opposite to each other; and the processor is used for detecting the screen state of the screen after detecting an opening request for a preset scene sound effect mode, and controlling the sound effect loudspeaker at the preset position corresponding to thescreen state to play sound according to the scene sound effect mode. The embodiment of the invention further provides a sound effect control method. According to the embodiment of the invention, themobile terminal can distinguish the left sound channel from the right sound channel, the sound effect more suitable for the current application scene is manufactured, the sound quality is greatly improved, the immersion experience is improved, the integration of the terminal and the viscosity of a user to the mobile terminal are improved, and convenience is provided for the user.

The invention belongs to the technical field of virtual reality, and discloses an image big data interactive control system and method based on virtual reality, the system comprising an image acquisition module, an image synthesis module, a central processing module, an iris recognition module, a scene rendering module, a data storage module and a display module. The invention determines an objectto be rendered through the scene rendering module in combination with the position relationship, and then renders the object to be rendered, and the object at some positions in the virtual scene is not rendered, so that the rendering load can be reduced compared with the prior art. At the same time, the display module can display the virtual reality interface adaptively according to the angle ofview of the user's eyes, so as to improve the user experience, and the user can interact with the virtual reality device without using the peripheral handle, so as to enhance the immersion experienceof the virtual reality.

The invention belongs to the technical field of teaching education robot, and discloses an education robot on the basis of situational teaching and a situational teaching method. The situational teaching method for the education robot includes carrying out teaching preparation before classes and constructing resource libraries; 'selecting, constructing and designing current situation tasks' in theclasses, 'selecting situation task teaching modes and planning teaching procedures, 'executing the teaching procedures and autonomously generating innovation elements, joviality, voice and situations', and 'carrying out man-machine interaction'; carrying out personalized exercise after the classes. The education robot comprises a head, a trunk and four limbs. The education robot and the situational teaching method have the advantages that the education robot and the situational teaching method are favorable for upgrading the teaching personalization level; learning states and the interactionperformance of students can be analyzed by the education robot, knowledge mastery conditions of the students can be judged, teaching contents can be timely correspondingly adjusted, accordingly, the efficiency can be improved, and the student personalized teaching level can be upgraded.

The invention relates to the field of VR technologies, and discloses a spatial position detection method and system and a VR wearing device. The method comprises the steps that the VR wearing device transmits a first radio frequency signal to at least three reference objects in a specific space and receives a first reflected signal transmitted by each reference object for the first radio frequency signal; according to the time of receiving the first reflected signal transmitted by a reference object and the time of transmitting the first radio frequency signal, the relative distance between the reference object and the VR wearing device in a particular space is acquired, and at least three relative distances are acquired according to at least three reference objects; the spatial position information of the VR wearing device in the particular space is acquired according to at least three relative distances; the spatial position information is transmitted to a VR host device; the VR host device carries out processing according to the spatial position information to acquire a virtual environment, and the virtual environment is received and displayed; the real environment position of a user is detected in real time and used as the control input of the virtual environment; and the immersive experience of the user in the virtual environment is improved.

The invention discloses a three-dimensional scene presentation method and device, equipment and a storage medium. The method comprises the steps of acquiring a first spatial position relation betweena virtual camera and a virtual screen in a virtual scene Obtaining a view matrix of the virtual camera according to the first spatial position relation, and obtaining a projection matrix of the virtual camera based on an observation mode; Obtaining the texture of the virtual camera in the virtual scene based on the view matrix and the projection matrix; And inputting the texture into a graphic processor, and rendering the virtual scene corresponding to the texture to display equipment by the graphic processor. Different three-dimensional scene presentation methods are selected according to different types of virtual scenes, and the three-dimensional scene presentation mode is determined by the observation mode, so that users at different observation angles can obtain the optimal visual angle, and the immersion experience of the users is improved.

The present disclosure discloses a wraparound interface layout method, which adopts a user-centered wraparound layout in a stereo space, thus more display objects are available for the layout, and the expansibility is better; by clearly presenting the display objects located in a user's sight line to the user, main content in the interface is effectively highlighted, so that the user finds the sense of presence, and a better user experience is achieved; in addition, the distances from the display objects to the human eyes are corrected, which avoids the undesirable display effect that the objects close to the user are visually larger and the objects far away from the user are visually smaller, and provides a more comfortable viewing experience. The present disclosure discloses a content switching method and a list switching method under a three-dimensional immersive environment, which sufficiently utilizes spatial characteristics under the three-dimensional immersive environment, a content to be presented is divided into a plurality of content units, and only display the current content unit or the current list within the scope of the user's sight line, thereby effectively highlighting the content to be displayed, visually improving the sense of space, and enhancing the user's three-dimensional immersive experience. Moreover, the user's switching operation is simplified, thus through a very simple action within a narrow range, the user can complete the content switching or the list switching, and enjoy a smooth and accurate switching experience.

The invention discloses a real-time image superposition method and device for augmented reality (AR). The method includes the following steps: acquiring video information generated when a monocular camera photographs a preset scene in real time, and determines the key frames in the video information; establishing point cloud data in real time according to the current key frame and the key frame previous to the current key frame; projecting the point cloud data corresponding to the current key frame to the current key frame, and determining the planes in the current key frame and the longest edge line in each plane according to the projection result and the super pixel segmentation result of the current frame; and when superposing a virtual image onto a first plane in the current key frame,fitting the fitting faces of the main features in the virtual image into the first plane, and making the forward edges of the main features parallel or perpendicular to the edge lines of the first plane through setting. Visual experience of the AR technology can be provided for users without the need to digitize a real environment in advance, and the real-time performance is strong.

The invention discloses an image reconstruction method for a cross-modal communication system. The method comprises the following steps: reconstructing a missing image in a transmission process through employing a complete tactile signal received by a receiving end in the cross-modal communication system, and constructing a cross-modal interaction network in combination with an attention mechanism. The limitation that a traditional generation model can only train paired samples is solved. The invention further discloses an image reconstruction device for the cross-modal communication system. According to the method, the semantic correlation among different modal data is fully utilized. The cross-modal generation from the tactile signal to the image is realized for unpaired data. The problem that practical training tactile signal-image data is difficult to acquire in pairs in a cross-modal communication system is solved. The quality and the category precision of the generated image are remarkably improved.

A kinesthetically enabled glove for providing kinesthetic feedback to a user are provided. The kinesthetically enabled glove incorporates various actuators configured to provide resistance to movement and / or to provide movement. Kinesthetic actuators employed include electroadhesive actuators, electromagnetic actuators, air-jamming actuators, and inertial mass actuators. The kinesthetic actuators are arranged in various portions of the kinesthetically enabled glove to provide force feedback at different locations. The kinesthetic glove may be employed during interaction with a computer system, providing a user with a more immersive experience.

The invention discloses a virtual dynamic field depth change processing method with human eye focusing simulation. Staring positions of eyeballs of two eyes in a virtual reality scene are obtained; according to the staring positions of eyeballs of two eyes, each frame of image in the virtual reality scene is processed in real time to obtain an expected focusing distance between a virtual staring object and a virtual lens under a current frame; calculation is carried out based on the expected focusing distance and an internal reference parameter of the virtual lens, thereby obtaining a dispersion circle radius; on the basis of the dispersion circle radius, a blurring effect is constructed; and the blurring effect is superposed on a current frame of an original virtual reality scene for displaying, thereby completing field depth change processing. According to the invention, the focusing distance of the user eyes of the head-mounted displays can be monitored dynamically and thus the dispersion circle radius can be calculated in real time; the special blurring effect is added on the original image and thus the depth-of-field effect of object observation by human eyes in real life can be simulated effectively, so that the immersive experience of the user can be improved substantially.

The embodiment of the invention provides an intelligent recognition method and intelligent interaction method for traditional culture gestures and a related device, and the intelligent identificationmethod comprises the steps: collecting a video image of a current user located in a target collection region, and building a coordinate system corresponding to the current user based on the position information of the user in the video image; recognizing human skeleton key point coordinates of the corresponding current user according to the coordinate system; and determining a preset value of eachtraditional culture gesture feature by applying the human skeleton key point coordinates of the current user, judging whether the value of each traditional culture gesture feature meets a respectivecorresponding preset condition or not, and if so, determining that the current user makes a corresponding traditional culture gesture. According to the method, the traditional culture gesture can be automatically recognized, the intelligent degree and efficiency of the recognition process are high, the accuracy and reliability of the recognition result of the traditional culture gesture can be effectively improved, and then the accuracy and intelligent degree of user interaction can be effectively improved.

The invention belongs to the field of teaching application of a virtual reality technology, and provides a virtual learning environment multi-channel fusion display method for field practice teaching,which comprises three steps of content generation, audio-visual channel fusion and multichannel interaction design. According to the characteristics of teaching contents in a VR learning environment,a set of generation method from data acquisition, knowledge organization and scene switching is established; synchronous updating of audio-visual channels is realized through a space rendering mode;the input and output priorities of each interaction channel are evaluated, and the multi-sensory collaborative interaction of learners in the VR learning environment is completed. Through adding of auditory cues and multi-channel user interaction discrimination modes, the VR learning environment fusion display is realized, the sense of reality of a learning environment can be improved, and the immersion experience of participants is improved.

The invention discloses a multi-person free shooting identifying system facing to a 7D shooting cinema and a multi-person free shooting identifying method. The multi-person free shooting identifying system comprises a network connecting module, an interactive control module, a three-dimensional rendering module and a projection display module; the network connecting module is used for transmitting a picture captured by an infrared camera to the interactive control module through network, and transmitting the user interactive information to be collected to a computer; the interactive control module, which is used for analyzing the obtained interactive information, and obtaining the front sight position of a user imitation gun and information if a user shoots; after completing the interactive shooting task, every user is supported to handhold a wireless imitation gun to interactively shoot, and a laser emitter is only arranged on the imitation gun; and therefore, an additional sensor is not in need. The system captures the screen picture through the infrared camera; through analysis of obtained sight position and the shooting information of the imitation gun of the user, the interactive shooting task is completed. Without the restriction of a power line, every user can fully and freely move, so that every user has the feeling of being personally on the scene; and thereby, the user experience is enhanced.

The present disclosure relates to a vibration generation device, a display apparatus including the vibration generation device, and a vehicle including the vibration generation device. A vibration generation device includes a piezoelectric ceramic part having a certain interval, a piezoelectric material layer between the piezoelectric ceramic parts, and an electrode part configured to provide electric field to one or more of the piezoelectric ceramic part and the piezoelectric material layer.

The invention discloses a real-time image superposition method and device for augmented reality (AR). The following technical scheme is adopted: when a monocular camera photographs a preset scene in real time, the planes in the current key frame and the longest edge line in each plane are determined; and when a virtual image is superposed to a first plane in the current key frame, the fitting faces of the main features in the virtual image are fitted into the first plane, and the forward edges of the main features are set to be parallel or perpendicular to the edge lines of the first plane. Therefore, visual experience of the AR technology can be provided for users without the need to digitize a real environment in advance, the steps before users experience the AR technology are avoided, the real-time performance is strong, and the scope of applications is greatly expanded. Meanwhile, the actual edge of the plane in a real environment is considered, and the authenticity of the main features in the virtual image is obviously improved.