333 results about "Virtual screen" patented technology

The invention relates to the technical field of electronic equipment, and discloses a screen projection method and device and electronic equipment, which are used for realizing multi-screen simultaneous watching during different-source screen projection. The method is applied to a screen projection system and comprises the steps that first electronic equipment responds to screen projection operation of a user for an application, creates a first virtual screen and generates a user interface of the application on the first virtual screen; the first electronic equipment can copy the user interface generated on the first virtual screen to the display screen of the first electronic equipment for display while projecting the user interface of the application generated on the first virtual screen to the second electronic equipment, so that multi-screen simultaneous watching of the first electronic equipment and the second electronic equipment is realized.

The invention discloses a distributed screen projection method and system based on GPU rendering, and the method comprises the steps: calling a window management interface and a graphic interface, and creating a virtual screen; setting one or more surface layers on the virtual screen, and drawing image data on the surface layers; and completing the synthesis of the image data on the surface layer by using a graphics processing unit (GPU), encoding the synthesized image data through a multimedia encoding and decoding service, and sending the encoded image data to a receiving end in a distributed manner for screen projection display. According to the method, the virtual screen is created by calling the window management interface and the graphic interface, image data synthesis is completed by utilizing the GPU, efficient coding is performed through the multimedia coding and decoding service, and finally the image data are sent to the receiving end in a distributed manner for screen projection display, so that low-delay and high-resolution compatible distributed screen projection is realized.

The invention provides a virtual screen processing method and electronic equipment, and is applied to the technical field of terminals. The method comprises the following steps: when an image processing process performs GI synthesis of a first frame, using a communication thread in the image processing process to communicate with an application process to obtain a communication result. And when the communication result is normal, sending the synthesized GI to a virtual screen created by the application process. And when the communication result is abnormal, deleting the virtual screen object. At the moment, when the application process does not respond in time or communication with the image processing process is abnormal, the task thread of the image processing process is prevented from being blocked, so that the abnormal influence is controlled in the communication thread, and other task threads are not influenced. Thus, the communication thread is split from the image synthesis thread, the communication thread is used for communicating with the application process, the frozen screen problem of the display interface of the electronic equipment is solved to a certain extent, and the equipment stability and the user experience are improved.

The present disclosure provides a method of alleviating motion sickness in a user viewing an image on a display, the method comprising: displaying an image on a display device, the display device being a first distance from a user viewing the image on the display device; generating a virtual screen corresponding to the display device by projecting a line from the user and the display device to a second location, the distance of the second location from the user being greater than the first distance; detecting a movement of the user and the display device to a new location relative to the virtual screen; determining a new image location by projecting a line from the virtual screen location to the new location of the user; and displaying an image on the display device at the new image location for at least a portion of the image for which the new image location intersects with the display device.

The invention provides a display method, system and device and a storage medium, the method is applied to a first electronic device, the first electronic device is in communication connection with a second electronic device, and the second electronic device is provided with a display screen. The method comprises the following steps: the first electronic equipment acquires a first operation request message sent by the second electronic equipment in a preset mode, wherein the first operation request message is sent by the second electronic equipment in response to a first operation aiming at a first interface; the first electronic device determines the screen size of a virtual screen corresponding to the target application in response to the first operation request message; the first electronic equipment starts a parallel field-of-view mode, and generates a second interface of the virtual screen based on the screen size in the parallel field-of-view mode; and the first electronic equipment outputs first control data, wherein the first control data is used for controlling the second electronic equipment to display the second interface on the display screen.

Devices, methods, systems, and media are described for providing an extended screen distributed user interface in an augmented reality environment. GUI layout information for laying out a conventional 2D GUI is processed in order to generate an extended screen DUI for display partially on a 2D display device and partially on one or more virtual screens of an AR environment viewed using an AR display device, such as a head mounted display. GUI elements are laid out in the DUI based on a primary modality of the GUI element (input or output), and / or based on spatial dependencies between GUI elements encoded in the GUI layout information. Methods for switching focus between two software application instances displayed in the DUI are also disclosed.

The embodiment of the invention discloses a service guiding method and device, electronic equipment and a computer readable storage medium, and relates to the technical field of augmented reality. The method comprises the following steps: determining a target service, and obtaining preparatory work required by the target service from a target system of the target service; intelligently guiding the user to complete preparatory work based on the AR technology, and detecting whether the preparatory work is completed or not; sending an online queuing request of a user to a target system, obtaining number calling information returned by the target system, and displaying the number calling information in real time by using a virtual screen of the AR equipment; and when the number calling information is about to call the user and the preparatory work is completed, displaying a virtual navigation element in a real environment through a virtual screen so as to guide the user to go to a providing place of the target service. Therefore, the scheme can effectively improve the service efficiency.

The embodiment of the invention provides a special effect rendering method and device.The special effect rendering method comprises the steps that a special effect rendering request is obtained, the special effect rendering request comprises at least one piece of initial special effect data, and the initial special effect data comprises at least one piece of special effect attribute information; based on the special effect attribute information corresponding to the initial special effect data, obtaining at least one initial special effect group; obtaining a special effect cutting strategy corresponding to each initial special effect group, processing the initial special effect group corresponding to each special effect cutting strategy according to each special effect cutting strategy, and determining at least one piece of target special effect data; and rendering each piece of target special effect data to display a virtual picture corresponding to the special effect rendering request. The number of same-screen special effects is effectively reduced through a special effect cutting strategy, the rendering efficiency is improved, and the problem of game frame rate fluctuation caused by complex special effects is solved.

The embodiment of the invention discloses a screen projection method and device, a terminal and a storage medium, and relates to the technical field of screen projection. Comprising the steps of determining a target adaptive resolution from at least two adaptive resolutions supported by an application program based on an expected resolution of a destination end under the condition that a screen projection demand exists; determining a virtual screen resolution of a virtual screen based on the target adaptive resolution, wherein the aspect ratio of the virtual screen resolution is consistent with the aspect ratio of the target adaptive resolution; based on the virtual screen resolution, the source end coding resolution and the expected resolution, determining a target coding resolution, the source end coding resolution being related to the coding capability of the source end; performing video coding on the application picture by using a coder with a target coding resolution to obtain a screen projection data stream; and transmitting the screen projection data stream to the destination end, so that the destination end performs screen projection display based on the screen projection data stream. According to the scheme, black edges appearing when the target end displays the screen projection picture can be reduced.

The present invention presents a method and device. A headset comprising a display, wherein the headset is at least one of an AR, VR or mixed reality headset, wherein the headset is used by a first user. A computer system comprising a plurality of computer processors with one or more network interfaces. A virtual 3D space comprising at least one live streaming video and a 3D model. A live streaming video content creator, wherein the live streaming video is being live broadcast by the live streaming video content creator. Displaying the live streaming video in the virtual 3D space on the first user's mixed reality headset display. Displaying a live streaming video in the virtual 3D space on the campaign backer's computing device's display, wherein a combination of a live streaming video shown on a virtual screen and a 3D model is displayed.

The embodiment of the invention discloses a split-screen display method, head-mounted display equipment and a computer readable medium. A specific embodiment of the method comprises the steps of displaying a main application page of a two-dimensional application in response to detection of starting information corresponding to the two-dimensional application; in response to the detected page jump selection operation of the main application page and the page jump selection operation meeting a preset screen splitting condition, executing the following screen splitting steps: monitoring the page jump selection operation; changing attribute information of an application page corresponding to the page jump selection operation to obtain a changed application page; and displaying the changed application page in a sub-virtual screen in the three-dimensional virtual space. According to the implementation mode, the multiple application pages of one two-dimensional application can be displayed at the same time, the operation steps for displaying the application pages can be simplified, time consumed for displaying the application pages is shortened, and consumed computing resources are reduced.

The invention relates to the technical field of surgical operations, in particular to an AR-based intelligent vision use method applied to surgical operations. The method comprises the following steps: S1, acquiring an anatomical structure image of a patient in real time through AR glasses equipment, and performing multi-modal fusion registration on the anatomical structure image and preoperative CT, MRI and 3D ultrasonic image data to generate a dynamic three-dimensional surgical navigation model; according to the method, multi-mode image fusion is combined with dynamic three-dimensional navigation, submillimeter intraoperative positioning is achieved, the misoperation risk is remarkably reduced, the intraoperative adjustment frequency is reduced through eye-controlled amplification and real-time early warning, and the operation time is shortened; meanwhile, the virtual screen and microscope linkage technology relieves the burden of the cervical vertebra and reduces the neck load of medical staff, and compared with a traditional teaching mode through holographic labeling and operation tracks, the training period of doctors can be obviously shortened, idle equipment can be automatically recognized, and the surgical accuracy, efficiency and medical resource popularity can be comprehensively improved.

Embodiments of the present application relate to the technical field of three-dimensional reconstruction, and disclosed are a three-dimensional model output method, apparatus and device, and a computer readable storage medium. The method comprises: acquiring a plurality of initial images of a target object or a target area to perform three-dimensional reconstruction; establishing a three-dimensional model for the target object or the target area; then projecting the generated three-dimensional model on a virtual screen; and outputting an image, which is obtained by projection, on the virtual screen. In this way, the generation of the three-dimensional model is faster, there is no need for technicians to manually construct the model, the image output data volume is lower, and the output speed is faster.

Systems and methods for controlling a surgical robot comprising a base, and an arm extending from the base to an attachment for an instrument, the arm comprising a plurality of joints whereby the configuration of the arm can be altered. The system includes: a display device configured to present a view of a virtual scene to an operator of the virtual reality display device, the virtual scene comprising a virtual screen on which a representation of a real-time video stream of a surgical site is displayed; an input tracking system configured to track a position of one or more free-space inputs in space; and a control unit configured to translate the tracked position of the one or more inputs free-space into one or more control signals to control the position of the arm of the surgical robot.

An application sharing method and an electronic device are provided. An exemplary method includes: receiving a first input; displaying N second electronic device identifiers in a first display region in response to the first input, where N is a positive integer; receiving a second input; displaying a running interface of a target application in a virtual screen in response to the second input; and sharing the running interface of the target application with L first target electronic devices. Electronic device identifiers corresponding to the L first target electronic devices are contained in the N second electronic device identifiers.

The invention relates to the technical field of VR, and provides a screen capture and recording method in a virtual world and virtual reality equipment, which are used for realizing local screen capture and recording. According to the method, during screen capture and recording, an operation frame changing along with the change of a user viewpoint is displayed in a current virtual picture, so that a target area of screen capture or screen recording meeting requirements can be flexibly selected by adjusting the position information of the user viewpoint relative to the current virtual picture, and local screen capture and recording are realized; and the picture of the target area is displayed on the current virtual picture in an overlapping manner by creating the picture layer, so that the user can preview the effect of the local screen capture and recording, and the accuracy of the local screen capture and recording is ensured. The image layer is hidden after the screen capture and recording operation is received, so that interference to the current virtual picture is avoided, and since the screen capture or recording operation is directly performed on the target area of the current virtual picture, the original resolution of a local screen capture image or a local screen recording image can be ensured, and the quality of the local screen capture image or the local screen recording image is improved.

The embodiment of the present application discloses a speech processing method, device, electronic device and computer-readable storage medium, and the method is applied to an extended reality device. The method includes: when a first speech acquisition device acquires a first speech, acquiring the current facial electromyogram of the wearer; acquiring a pre-acquired target facial electromyogram when the wearer is speaking; determining whether the wearer is speaking based on the current facial electromyogram and the target facial electromyogram; when the wearer is speaking, acquiring a second speech acquisition device to directionally acquire a second speech; distinguishing the speech of the non-wearer based on the first speech and the second speech; converting the speech of the non-wearer into text, and displaying the text on a virtual screen. In this way, the present solution can determine whether the wearer is speaking through the facial electromyogram of the wearer, thereby accurately distinguishing the speech of the wearer and the non-wearer, and then accurately displaying the text converted from the speech of the non-wearer on the virtual screen.

The embodiment of the present application discloses a method, device, system and medium for screen display, the method comprising: obtaining active window information on each screen, the active window information comprising a virtual screen identifier, the virtual screen identifier being used to mark the virtual screen on which the active window is displayed, the active window displayed on the virtual screen carrying the virtual screen identifier, each screen corresponding to a virtual screen respectively, the virtual screen carrying a default identifier for distinguishing each virtual screen, the default identifier of the virtual screen being consistent with the virtual screen identifier of the virtual screen, the active window being one or more interfaces displayed on the screen; changing the virtual screen identifier of the virtual screen to be switched according to the first switching operation of the user on the screen to be switched among the screens, and sending the active window carrying the target virtual screen identifier to the virtual screen to be switched for display. Implementing the embodiment of the present application can improve the stability of synchronous display of two or more screens in a vehicle-mounted environment.

The invention provides a man-machine interaction method, an electronic device and a related device.In the method, a virtual screen can be arranged between a control device and a screen of the electronic device, the distance between the virtual screen and the control device is a preset distance, and the control device faces the virtual screen; therefore, no matter how the distance between the control equipment and the screen and the orientation of the control equipment are, the virtual screen can be assumed as a screen interacting with the user, and the distance and the relative position between the virtual screen and the control equipment are not changed, so that the user can feel consistent experience when operating the control equipment. Besides, after the electronic equipment acquires the position of the control equipment on the virtual screen, the position can be converted into the position of the cursor on the screen, and the electronic equipment can correspondingly control the cursor on the screen to move along with the operation of the control equipment by the user. In addition, since the control equipment faces the virtual screen, the control equipment does not need to directly face the screen all the time, and the user experience can be improved.

A wearable device is provided. The wearable device may comprise at least one processor, a display, and at least one processor. The at least one processor is configured to: identify, using at least one camera, an object included in a virtual screen displayed through the display; determine whether the identified object corresponds to a type for limiting a representation of a hand object of a user; display, through the display, a virtual screen including the hand object on the basis of hand tracking according to a determination that the identified object does not correspond to the type; and display, through the display, a virtual screen that does not display a movement of the hand object according to the hand tracking, on the basis of identifying that the hand object is located within a threshold distance from the object according to a determination that the identified object corresponds to the type.

Provided are computer-implemented methods and systems for optimization of publication of an application to a web browser. An example method for optimization of publication of an application to a web browser may include capturing, by a server-side agent, a video frame of a virtual screen associated with the application. The method may further include comparing, by the server-side agent, the video frame to a previous video frame of the virtual screen to detect a change in the video frame. The method may continue with generating, by the server-side agent, an image of the change based on the detection. The method may further include sending, by the server-side agent, the image of the change to a client device. The virtual screen may be re-rendered on the client device based on the image of the change and the previous video frame.

The invention discloses a method and device for processing a three-dimensional image, a computer readable storage medium and computing equipment. According to the method for processing the three-dimensional image, the three-dimensional image is a parallax image which is shot by a virtual camera and then displayed on a display device, and the method comprises the steps that under the condition that it is detected that the position of human eyes is updated through a head tracking device, coordinates of a virtual screen point on a virtual display screen in a camera space are obtained; the virtual display screen is a region of interest watched by a user; determining a near cutting plane based on the coordinates of the virtual screen point in the camera space; changing a near cutting plane into an inclined cutting plane; the inclined cutting plane is a plane which is used for cutting off pixel points outside the virtual display screen and is parallel to the virtual display screen; changing the projection matrix, and adjusting the virtual display screen to be parallel to the display screen of the display equipment by using the changed projection matrix to obtain a front view of the virtual display screen; and rendering the front view, and outputting a rendering result to a display device.

The invention provides an application returning method and electronic equipment, and the method comprises the steps: judging whether a first task currently executed by a first application is a preset task or not when a user executes the operation of switching the first application to a background, and returning the first application to the background when the first task is the preset task; the first task continues to be executed in the mode that the first task is projected to the virtual screen, the execution progress of the first task can be detected in the period of executing the first task, and a user is prompted once the first task is executed, so that the user can conveniently return to the first application from display interfaces of other applications in time. According to the scheme, the judgment on the task type of the currently executed task is added, and the preset task is continuously executed by adopting a special execution process, so that the task is ensured not to be interrupted, and a user can be timely reminded to return to the application, so that the user can use other applications within the task execution time period without worrying about waiting, and the user experience is improved. And thus, the user experience is improved.

To provide a more convenient information processor in using an HMD and a portable terminal in combination.SOLUTION: An information processor includes picture acquisition means for acquiring an imaged picture and display control means for performing control so as to display, on the display means, a synthesized picture obtained by synthesizing a virtual screen with the imaged picture. The display control means performs controls so as to display the virtual screen vertically when a portable terminal is vertically seen from a user and display the virtual screen horizontally when the portable terminal is horizontally seen from the user.SELECTED DRAWING: Figure 1

The embodiment of the invention discloses a depth distance determination method and device, electronic equipment and a medium, and relates to the technical field of universe, and one specific implementation mode of the method comprises the steps that the field angle of view, the lens resolution and the pupil distance between two eyes of a user of virtual interaction equipment are acquired; and based on the field angle, the lens resolution and the interpupillary distance between the two eyes of the user, determining the depth distance of virtual screen display of the virtual interaction device. In the process, the optimal depth distance of the exclusive virtual screen of the virtual interaction equipment is accurately calculated by using data such as the field angle of the virtual interaction equipment, the lens resolution and the interpupillary distance between two eyes of the user, so that dual adaptation between the depth of the virtual screen and equipment hardware characteristics and between the depth of the virtual screen and physiological parameters of the user is realized; and the film watching immersion and the operation experience of the user are effectively improved.

A request to share an object is received within a virtualized screen sharing management application. A virtualized display for sharing the object is generated. The object is mapped to the virtualized display. Responsive to the request, the object is shared within the virtualized screen sharing management application via the virtualized display.

The application discloses a photovoltaic power station monitoring method and system based on three-dimensional image modeling and virtual simulation fusion, relates to the technical field of image modeling, and comprises the following steps: generating a reflection response graph according to an original inspection graph of a photovoltaic power station, sequentially performing adaptive threshold segmentation and morphological processing on the reflection response graph to obtain a candidate reflection graph of a screen; performing skeleton extraction on the candidate reflection graph of the screen to obtain a candidate highlight skeleton graph, screening out attached edge pixel points according to a skeleton pixel point set in the candidate highlight skeleton graph, connecting the attached edge pixel points to obtain an edge traction sliding graph; generating a basic outer adjacent band according to a three-dimensional model of a station of the photovoltaic power station, performing region merging on the basic outer adjacent band to obtain a grounding conductor layout band, and performing projection on the grounding conductor layout band to obtain a virtual screen corridor projection graph; and the application improves the reliability of a photovoltaic power station monitoring result.

The invention provides a user interface anomaly detection and recovery method and system, equipment and a storage medium, and the anomaly detection method comprises the steps: building a virtual screen matched with an actual screen in the equipment, and building a plurality of first to-be-displayed interfaces associated with a current display interface in the actual screen in the virtual screen in advance; the plurality of first to-be-displayed interfaces are arranged by taking the same set position as a reference, responding to a user interface switching instruction, and determining whether the switched current display interface in the actual screen is abnormal or not based on the current display interface, the plurality of first to-be-displayed interfaces and the virtual screen. The method has the advantages of being accurate in anomaly detection, high in compatibility, good in expandability and the like while the efficient performance is guaranteed, real-time monitoring and recovery of the user interface can be achieved by introducing the virtual screen concept and simple coordinate judgment, and the quality of the user interface and the user experience are improved.

The embodiment of the invention provides a display method and device of ink screen equipment, electronic equipment and a storage medium, the ink screen equipment comprises a first ink screen and a second ink screen, the method comprises the steps that a virtual screen is constructed, and the virtual screen comprises a first area and a second area; receiving a page display instruction for the ink screen equipment, and performing paging processing on to-be-displayed content to obtain multi-page content; according to the page display instruction, determining first content rendered in a first area and second content rendered in a second area in the multi-page content; first content is rendered in a first region and mapped into a first ink screen, and second content is rendered in a second region and mapped into a second ink screen. According to the method, the ink screen device integrates the double physical screens (namely the first ink screen and the second ink screen) into a logically unified display plane by constructing the virtual screen, so that the reading experience of a user is improved.

Various implementations disclosed herein include devices, systems, and methods that uses a horizontal shift of left eye and right eye image content to control a stereo effect of the image content. For example, a process may include obtaining image data including images to be presented with a stereo effect at a virtual screen position within a three-dimensional (3D) viewing environment. The process may further obtain depth data corresponding to distances of elements of a scene depicted in the images. The process may further determine a horizontal positioning characteristic for presenting the images at the virtual screen with the stereo effect based on the depth data and a view of the images are presented with the stereo effect based on the horizontal positioning characteristic at the virtual screen within the 3D environment. The images may additionally be presented with a blur, a lighting, a fading, and / or a vignetting effect.