238 results about "Virtual screen" patented technology

The invention relates to the technical field of electronic equipment, and discloses a screen projection method and device and electronic equipment, which are used for realizing multi-screen simultaneous watching during different-source screen projection. The method is applied to a screen projection system and comprises the steps that first electronic equipment responds to screen projection operation of a user for an application, creates a first virtual screen and generates a user interface of the application on the first virtual screen; the first electronic equipment can copy the user interface generated on the first virtual screen to the display screen of the first electronic equipment for display while projecting the user interface of the application generated on the first virtual screen to the second electronic equipment, so that multi-screen simultaneous watching of the first electronic equipment and the second electronic equipment is realized.

The invention discloses a distributed screen projection method and system based on GPU rendering, and the method comprises the steps: calling a window management interface and a graphic interface, and creating a virtual screen; setting one or more surface layers on the virtual screen, and drawing image data on the surface layers; and completing the synthesis of the image data on the surface layer by using a graphics processing unit (GPU), encoding the synthesized image data through a multimedia encoding and decoding service, and sending the encoded image data to a receiving end in a distributed manner for screen projection display. According to the method, the virtual screen is created by calling the window management interface and the graphic interface, image data synthesis is completed by utilizing the GPU, efficient coding is performed through the multimedia coding and decoding service, and finally the image data are sent to the receiving end in a distributed manner for screen projection display, so that low-delay and high-resolution compatible distributed screen projection is realized.

The invention provides a virtual screen processing method and electronic equipment, and is applied to the technical field of terminals. The method comprises the following steps: when an image processing process performs GI synthesis of a first frame, using a communication thread in the image processing process to communicate with an application process to obtain a communication result. And when the communication result is normal, sending the synthesized GI to a virtual screen created by the application process. And when the communication result is abnormal, deleting the virtual screen object. At the moment, when the application process does not respond in time or communication with the image processing process is abnormal, the task thread of the image processing process is prevented from being blocked, so that the abnormal influence is controlled in the communication thread, and other task threads are not influenced. Thus, the communication thread is split from the image synthesis thread, the communication thread is used for communicating with the application process, the frozen screen problem of the display interface of the electronic equipment is solved to a certain extent, and the equipment stability and the user experience are improved.

The invention provides a display method, system and device and a storage medium, the method is applied to a first electronic device, the first electronic device is in communication connection with a second electronic device, and the second electronic device is provided with a display screen. The method comprises the following steps: the first electronic equipment acquires a first operation request message sent by the second electronic equipment in a preset mode, wherein the first operation request message is sent by the second electronic equipment in response to a first operation aiming at a first interface; the first electronic device determines the screen size of a virtual screen corresponding to the target application in response to the first operation request message; the first electronic equipment starts a parallel field-of-view mode, and generates a second interface of the virtual screen based on the screen size in the parallel field-of-view mode; and the first electronic equipment outputs first control data, wherein the first control data is used for controlling the second electronic equipment to display the second interface on the display screen.

The embodiment of the invention discloses a service guiding method and device, electronic equipment and a computer readable storage medium, and relates to the technical field of augmented reality. The method comprises the following steps: determining a target service, and obtaining preparatory work required by the target service from a target system of the target service; intelligently guiding the user to complete preparatory work based on the AR technology, and detecting whether the preparatory work is completed or not; sending an online queuing request of a user to a target system, obtaining number calling information returned by the target system, and displaying the number calling information in real time by using a virtual screen of the AR equipment; and when the number calling information is about to call the user and the preparatory work is completed, displaying a virtual navigation element in a real environment through a virtual screen so as to guide the user to go to a providing place of the target service. Therefore, the scheme can effectively improve the service efficiency.

The present invention presents a method and device. A headset comprising a display, wherein the headset is at least one of an AR, VR or mixed reality headset, wherein the headset is used by a first user. A computer system comprising a plurality of computer processors with one or more network interfaces. A virtual 3D space comprising at least one live streaming video and a 3D model. A live streaming video content creator, wherein the live streaming video is being live broadcast by the live streaming video content creator. Displaying the live streaming video in the virtual 3D space on the first user's mixed reality headset display. Displaying a live streaming video in the virtual 3D space on the campaign backer's computing device's display, wherein a combination of a live streaming video shown on a virtual screen and a 3D model is displayed.

The embodiment of the invention discloses a split-screen display method, head-mounted display equipment and a computer readable medium. A specific embodiment of the method comprises the steps of displaying a main application page of a two-dimensional application in response to detection of starting information corresponding to the two-dimensional application; in response to the detected page jump selection operation of the main application page and the page jump selection operation meeting a preset screen splitting condition, executing the following screen splitting steps: monitoring the page jump selection operation; changing attribute information of an application page corresponding to the page jump selection operation to obtain a changed application page; and displaying the changed application page in a sub-virtual screen in the three-dimensional virtual space. According to the implementation mode, the multiple application pages of one two-dimensional application can be displayed at the same time, the operation steps for displaying the application pages can be simplified, time consumed for displaying the application pages is shortened, and consumed computing resources are reduced.

The invention relates to the technical field of surgical operations, in particular to an AR-based intelligent vision use method applied to surgical operations. The method comprises the following steps: S1, acquiring an anatomical structure image of a patient in real time through AR glasses equipment, and performing multi-modal fusion registration on the anatomical structure image and preoperative CT, MRI and 3D ultrasonic image data to generate a dynamic three-dimensional surgical navigation model; according to the method, multi-mode image fusion is combined with dynamic three-dimensional navigation, submillimeter intraoperative positioning is achieved, the misoperation risk is remarkably reduced, the intraoperative adjustment frequency is reduced through eye-controlled amplification and real-time early warning, and the operation time is shortened; meanwhile, the virtual screen and microscope linkage technology relieves the burden of the cervical vertebra and reduces the neck load of medical staff, and compared with a traditional teaching mode through holographic labeling and operation tracks, the training period of doctors can be obviously shortened, idle equipment can be automatically recognized, and the surgical accuracy, efficiency and medical resource popularity can be comprehensively improved.

Embodiments of the present application relate to the technical field of three-dimensional reconstruction, and disclosed are a three-dimensional model output method, apparatus and device, and a computer readable storage medium. The method comprises: acquiring a plurality of initial images of a target object or a target area to perform three-dimensional reconstruction; establishing a three-dimensional model for the target object or the target area; then projecting the generated three-dimensional model on a virtual screen; and outputting an image, which is obtained by projection, on the virtual screen. In this way, the generation of the three-dimensional model is faster, there is no need for technicians to manually construct the model, the image output data volume is lower, and the output speed is faster.

Systems and methods for controlling a surgical robot comprising a base, and an arm extending from the base to an attachment for an instrument, the arm comprising a plurality of joints whereby the configuration of the arm can be altered. The system includes: a display device configured to present a view of a virtual scene to an operator of the virtual reality display device, the virtual scene comprising a virtual screen on which a representation of a real-time video stream of a surgical site is displayed; an input tracking system configured to track a position of one or more free-space inputs in space; and a control unit configured to translate the tracked position of the one or more inputs free-space into one or more control signals to control the position of the arm of the surgical robot.

An application sharing method and an electronic device are provided. An exemplary method includes: receiving a first input; displaying N second electronic device identifiers in a first display region in response to the first input, where N is a positive integer; receiving a second input; displaying a running interface of a target application in a virtual screen in response to the second input; and sharing the running interface of the target application with L first target electronic devices. Electronic device identifiers corresponding to the L first target electronic devices are contained in the N second electronic device identifiers.

The embodiment of the present application discloses a speech processing method, device, electronic device and computer-readable storage medium, and the method is applied to an extended reality device. The method includes: when a first speech acquisition device acquires a first speech, acquiring the current facial electromyogram of the wearer; acquiring a pre-acquired target facial electromyogram when the wearer is speaking; determining whether the wearer is speaking based on the current facial electromyogram and the target facial electromyogram; when the wearer is speaking, acquiring a second speech acquisition device to directionally acquire a second speech; distinguishing the speech of the non-wearer based on the first speech and the second speech; converting the speech of the non-wearer into text, and displaying the text on a virtual screen. In this way, the present solution can determine whether the wearer is speaking through the facial electromyogram of the wearer, thereby accurately distinguishing the speech of the wearer and the non-wearer, and then accurately displaying the text converted from the speech of the non-wearer on the virtual screen.

The embodiment of the present application discloses a method, device, system and medium for screen display, the method comprising: obtaining active window information on each screen, the active window information comprising a virtual screen identifier, the virtual screen identifier being used to mark the virtual screen on which the active window is displayed, the active window displayed on the virtual screen carrying the virtual screen identifier, each screen corresponding to a virtual screen respectively, the virtual screen carrying a default identifier for distinguishing each virtual screen, the default identifier of the virtual screen being consistent with the virtual screen identifier of the virtual screen, the active window being one or more interfaces displayed on the screen; changing the virtual screen identifier of the virtual screen to be switched according to the first switching operation of the user on the screen to be switched among the screens, and sending the active window carrying the target virtual screen identifier to the virtual screen to be switched for display. Implementing the embodiment of the present application can improve the stability of synchronous display of two or more screens in a vehicle-mounted environment.

The invention provides a man-machine interaction method, an electronic device and a related device.In the method, a virtual screen can be arranged between a control device and a screen of the electronic device, the distance between the virtual screen and the control device is a preset distance, and the control device faces the virtual screen; therefore, no matter how the distance between the control equipment and the screen and the orientation of the control equipment are, the virtual screen can be assumed as a screen interacting with the user, and the distance and the relative position between the virtual screen and the control equipment are not changed, so that the user can feel consistent experience when operating the control equipment. Besides, after the electronic equipment acquires the position of the control equipment on the virtual screen, the position can be converted into the position of the cursor on the screen, and the electronic equipment can correspondingly control the cursor on the screen to move along with the operation of the control equipment by the user. In addition, since the control equipment faces the virtual screen, the control equipment does not need to directly face the screen all the time, and the user experience can be improved.

A wearable device is provided. The wearable device may comprise at least one processor, a display, and at least one processor. The at least one processor is configured to: identify, using at least one camera, an object included in a virtual screen displayed through the display; determine whether the identified object corresponds to a type for limiting a representation of a hand object of a user; display, through the display, a virtual screen including the hand object on the basis of hand tracking according to a determination that the identified object does not correspond to the type; and display, through the display, a virtual screen that does not display a movement of the hand object according to the hand tracking, on the basis of identifying that the hand object is located within a threshold distance from the object according to a determination that the identified object corresponds to the type.

Provided are computer-implemented methods and systems for optimization of publication of an application to a web browser. An example method for optimization of publication of an application to a web browser may include capturing, by a server-side agent, a video frame of a virtual screen associated with the application. The method may further include comparing, by the server-side agent, the video frame to a previous video frame of the virtual screen to detect a change in the video frame. The method may continue with generating, by the server-side agent, an image of the change based on the detection. The method may further include sending, by the server-side agent, the image of the change to a client device. The virtual screen may be re-rendered on the client device based on the image of the change and the previous video frame.

The invention discloses a method and device for processing a three-dimensional image, a computer readable storage medium and computing equipment. According to the method for processing the three-dimensional image, the three-dimensional image is a parallax image which is shot by a virtual camera and then displayed on a display device, and the method comprises the steps that under the condition that it is detected that the position of human eyes is updated through a head tracking device, coordinates of a virtual screen point on a virtual display screen in a camera space are obtained; the virtual display screen is a region of interest watched by a user; determining a near cutting plane based on the coordinates of the virtual screen point in the camera space; changing a near cutting plane into an inclined cutting plane; the inclined cutting plane is a plane which is used for cutting off pixel points outside the virtual display screen and is parallel to the virtual display screen; changing the projection matrix, and adjusting the virtual display screen to be parallel to the display screen of the display equipment by using the changed projection matrix to obtain a front view of the virtual display screen; and rendering the front view, and outputting a rendering result to a display device.

To provide a more convenient information processor in using an HMD and a portable terminal in combination.SOLUTION: An information processor includes picture acquisition means for acquiring an imaged picture and display control means for performing control so as to display, on the display means, a synthesized picture obtained by synthesizing a virtual screen with the imaged picture. The display control means performs controls so as to display the virtual screen vertically when a portable terminal is vertically seen from a user and display the virtual screen horizontally when the portable terminal is horizontally seen from the user.SELECTED DRAWING: Figure 1

The embodiment of the invention discloses a depth distance determination method and device, electronic equipment and a medium, and relates to the technical field of universe, and one specific implementation mode of the method comprises the steps that the field angle of view, the lens resolution and the pupil distance between two eyes of a user of virtual interaction equipment are acquired; and based on the field angle, the lens resolution and the interpupillary distance between the two eyes of the user, determining the depth distance of virtual screen display of the virtual interaction device. In the process, the optimal depth distance of the exclusive virtual screen of the virtual interaction equipment is accurately calculated by using data such as the field angle of the virtual interaction equipment, the lens resolution and the interpupillary distance between two eyes of the user, so that dual adaptation between the depth of the virtual screen and equipment hardware characteristics and between the depth of the virtual screen and physiological parameters of the user is realized; and the film watching immersion and the operation experience of the user are effectively improved.

A request to share an object is received within a virtualized screen sharing management application. A virtualized display for sharing the object is generated. The object is mapped to the virtualized display. Responsive to the request, the object is shared within the virtualized screen sharing management application via the virtualized display.

The application discloses a photovoltaic power station monitoring method and system based on three-dimensional image modeling and virtual simulation fusion, relates to the technical field of image modeling, and comprises the following steps: generating a reflection response graph according to an original inspection graph of a photovoltaic power station, sequentially performing adaptive threshold segmentation and morphological processing on the reflection response graph to obtain a candidate reflection graph of a screen; performing skeleton extraction on the candidate reflection graph of the screen to obtain a candidate highlight skeleton graph, screening out attached edge pixel points according to a skeleton pixel point set in the candidate highlight skeleton graph, connecting the attached edge pixel points to obtain an edge traction sliding graph; generating a basic outer adjacent band according to a three-dimensional model of a station of the photovoltaic power station, performing region merging on the basic outer adjacent band to obtain a grounding conductor layout band, and performing projection on the grounding conductor layout band to obtain a virtual screen corridor projection graph; and the application improves the reliability of a photovoltaic power station monitoring result.

The invention provides a user interface anomaly detection and recovery method and system, equipment and a storage medium, and the anomaly detection method comprises the steps: building a virtual screen matched with an actual screen in the equipment, and building a plurality of first to-be-displayed interfaces associated with a current display interface in the actual screen in the virtual screen in advance; the plurality of first to-be-displayed interfaces are arranged by taking the same set position as a reference, responding to a user interface switching instruction, and determining whether the switched current display interface in the actual screen is abnormal or not based on the current display interface, the plurality of first to-be-displayed interfaces and the virtual screen. The method has the advantages of being accurate in anomaly detection, high in compatibility, good in expandability and the like while the efficient performance is guaranteed, real-time monitoring and recovery of the user interface can be achieved by introducing the virtual screen concept and simple coordinate judgment, and the quality of the user interface and the user experience are improved.

The embodiment of the invention provides a display method and device of ink screen equipment, electronic equipment and a storage medium, the ink screen equipment comprises a first ink screen and a second ink screen, the method comprises the steps that a virtual screen is constructed, and the virtual screen comprises a first area and a second area; receiving a page display instruction for the ink screen equipment, and performing paging processing on to-be-displayed content to obtain multi-page content; according to the page display instruction, determining first content rendered in a first area and second content rendered in a second area in the multi-page content; first content is rendered in a first region and mapped into a first ink screen, and second content is rendered in a second region and mapped into a second ink screen. According to the method, the ink screen device integrates the double physical screens (namely the first ink screen and the second ink screen) into a logically unified display plane by constructing the virtual screen, so that the reading experience of a user is improved.

Various implementations disclosed herein include devices, systems, and methods that uses a horizontal shift of left eye and right eye image content to control a stereo effect of the image content. For example, a process may include obtaining image data including images to be presented with a stereo effect at a virtual screen position within a three-dimensional (3D) viewing environment. The process may further obtain depth data corresponding to distances of elements of a scene depicted in the images. The process may further determine a horizontal positioning characteristic for presenting the images at the virtual screen with the stereo effect based on the depth data and a view of the images are presented with the stereo effect based on the horizontal positioning characteristic at the virtual screen within the 3D environment. The images may additionally be presented with a blur, a lighting, a fading, and / or a vignetting effect.

The present application relates to the field of VR technology, and provides a method for capturing screenshots in a virtual world and a virtual reality device for realizing partial screenshots. When capturing a screenshot, the method displays an operation box that changes with the user's viewpoint in the current virtual screen, so that the target area for capturing or recording the screen that meets the needs can be flexibly selected by adjusting the position information of the user's viewpoint relative to the current virtual screen, thereby realizing partial screenshots; and by creating a layer, the screen of the target area is superimposed and displayed on the current virtual screen, so that the user can preview the effect of the partial screenshot and ensure the accuracy of the partial screenshot. When the screenshot operation is received, the layer is hidden to avoid interference with the current virtual screen. Since the screenshot or recording operation is directly performed on the target area of ​​the current virtual screen, the original resolution of the partial screenshot image or the partial screen recording image can be guaranteed, thereby improving the quality of the partial screenshot image or the partial screen recording image.

The embodiment of the invention discloses a shared bicycle management system, method and device, electronic equipment and a storage medium, and relates to the technical field of augmented reality. The system comprises AR glasses, a management platform and a shared bicycle, the AR glasses send a vehicle searching request and the first position information to the management platform; the management platform determines a candidate shared bicycle, queries the real-time state of the candidate shared bicycle, determines a target shared bicycle, and sends second position information of the target shared bicycle to the AR glasses; the AR glasses generate virtual navigation elements according to the second position information, and display the virtual navigation elements in the real world in an overlapping manner based on the virtual screen; the AR glasses collect information of the target shared bicycle based on the camera and send unlocking information to the management platform; after the management platform verifies the user identity and the target shared bicycle, an unlocking instruction is sent to the target shared bicycle to unlock the target shared bicycle. According to the scheme, a user can be guided to quickly find and unlock the shared bicycle in a good state.

The invention discloses a data processing method, and the method comprises the steps: obtaining a first image and a watching parameter, the first image being a 3D image, and the watching parameter comprising the information of a virtual screen; when the first image is displayed according to the watching parameters, obtaining a second image through rendering according to the first image and the watching parameters based on the condition that the parallax of the first image on the virtual screen meets a preset condition; the second image is an image which belongs to the same 3D video stream as the first image and is behind the first image, and the parallax of the second image on the virtual screen is different from the parallax of the first image on the virtual screen when the second image is displayed. According to the method and the device, the parallax adjustment of the image during the display of the 3D video is realized.

The invention relates to a device (10) for viewing a simulated image (100) of an internal target zone (Z) of a human body during a simulation of a medical imaging examination, the device (10) comprising an anatomical console (12) comprising an interaction surface (26) with at least one interaction zone (28), a dummy probe (14) with an interaction head (16) configured to cooperate with the interaction surface (26), a virtual scene (101) with a virtual screen (102), and a virtual reality system (18). The virtual screen of the virtual scene displays the simulated image (100) of all or part of the internal target zone in real time, when the interaction head of the dummy probe is cooperating with the at least one interaction zone of the interaction surface.

The application provides a game process control method and device, electronic equipment and storage medium. In the action stage, at least part of a first virtual scene and a first virtual object in the first virtual scene in the graphical user interface are displayed. An additional skill of the first virtual object is determined on the basis of a default skill of a character. When a virtual task completion progress in a game stage reaches a progress threshold, the first virtual object is controlled to unlock the additional skill, and an additional skill control for triggering the additional skill is provided in the graphical user interface. In response to a preset triggering event, the graphical user interface is switched to a second virtual screen of the discussion stage, and the game state of the first virtual object and each second virtual object is displayed. In this way, the game process can be accelerated, thereby reducing the consumption of the terminal power and data flow in the game process.

The present invention provides an extended reality shooting method and system, the method comprising the following steps: using the PTP method to synchronize the reference clock of the virtual screen display end and the image acquisition end; using the virtual screen display end to alternately display the virtual screens inputted from multiple channels according to a preset frequency and sequence, the refresh frequency of the displayed image is 1 / n times the acquisition frame rate of the image acquisition end, n is a positive integer, n=1,2,3...same value or multiple, and each round of alternately displayed images contains at least one pure color image; using the image acquisition end to acquire the image displayed by the virtual screen display end, and separating the acquired images. Using the scheme provided by the present invention, the image acquisition end can obtain a mixed image of multiple virtual images in one acquisition, and then the acquired images can be separated by the image acquisition end to obtain the separated rendering images and pure color images, so that the shooting images of the extended reality shooting system can be separated for post-processing.