Extended reality-based control method and apparatus, electronic device, and storage medium

Abstract

The present disclosure provides an extended reality-based control method, device, electronic equipment and storage medium. In some embodiments, the present disclosure provides an extended reality-based control method, comprising: displaying a virtual clock in an extended reality space, wherein the virtual clock is used to display time; determining a display position based on the current time to be displayed, and displaying the time at the display position; wherein the display position is associated with the time displayed by the virtual clock. The extended reality-based control method provided by the embodiments of the present disclosure can correspond to changes in the display position when the displayed time changes, and by changing the display position, a dynamic three-dimensional display is achieved.

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and more particularly to a control method, apparatus, electronic device, and storage medium based on extended reality. Background Technology

[0002] Extended reality technology includes virtual reality, augmented reality, and mixed reality. In extended reality spaces, virtual objects can be displayed, or a combination of virtual and real objects can be shown, thereby enhancing the user experience. Summary of the Invention

[0003] This disclosure provides a control method, apparatus, electronic device, and storage medium based on extended reality.

[0004] The following technical solution is adopted in this disclosure.

[0005] In some embodiments, this disclosure provides a control method based on extended reality, including:

[0006] A virtual clock is displayed in an extended reality space, wherein the virtual clock is used to display time;

[0007] The display position is determined based on the current time to be displayed, and the time is displayed at that position.

[0008] The display position is associated with the time displayed by the virtual clock.

[0009] In some embodiments, this disclosure provides a control device based on extended reality, including:

[0010] A display unit is used to display a virtual clock in an extended reality space, wherein the virtual clock is used to display time;

[0011] The control unit determines the display position based on the current time to be displayed, and displays the time at that position.

[0012] The display position is associated with the time displayed by the virtual clock.

[0013] In some embodiments, this disclosure provides an electronic device, including: at least one memory and at least one processor;

[0014] The memory is used to store program code, and the processor is used to call the program code stored in the memory to execute the above method.

[0015] In some embodiments, this disclosure provides a computer-readable storage medium for storing program code that, when run by a processor, causes the processor to perform the methods described above.

[0016] The extended reality-based control method provided in this disclosure allows the display position to change accordingly as the display time changes, thereby achieving a three-dimensional dynamic display. Attached Figure Description

[0017] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and elements are not necessarily drawn to scale.

[0018] Figure 1 This is a schematic diagram of an embodiment of the present disclosure using an extended reality device.

[0019] Figures 2 to 6 This is a schematic diagram illustrating an embodiment of the present disclosure using extended reality space.

[0020] Figure 7 This is a flowchart of a control method based on extended reality according to an embodiment of this disclosure.

[0021] Figure 8 This is a schematic diagram illustrating the time display effect of an embodiment of this disclosure.

[0022] Figure 9 This is a schematic diagram of a first plane and a second plane according to an embodiment of the present disclosure.

[0023] Figure 10 This is a schematic diagram of a virtual clock according to an embodiment of the present disclosure.

[0024] Figure 11 This is a schematic diagram of the structure of an electronic device according to an embodiment of the present disclosure. Detailed Implementation

[0025] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0026] It should be understood that the various steps described in the method embodiments of this disclosure can be performed in sequence and / or in parallel. Furthermore, method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect.

[0027] The term "comprising" and its variations as used herein are open-ended inclusions, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Definitions of other terms will be given in the description below.

[0028] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.

[0029] It should be noted that the use of the word "a" in this disclosure is illustrative rather than restrictive, and those skilled in the art should understand that it should be understood as "one or more" unless otherwise expressly indicated in the context.

[0030] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0031] The solutions provided by the embodiments of this disclosure will be described in detail below with reference to the accompanying drawings.

[0032] Extended reality can be at least one of virtual reality, augmented reality, or mixed reality. Taking extended reality as virtual reality as an example, such as... Figure 1 As shown, users can enter a virtual reality space through smart terminal devices such as VR headsets, and control their own virtual avatar to interact with other user-controlled virtual avatars for social interaction, entertainment, learning, remote work, and more.

[0033] The virtual reality space can be a simulation of the real world, a semi-simulated / semi-fictional virtual scene, or a purely fictional virtual scene. The virtual scene can be any of a two-dimensional, 2.5-dimensional, or three-dimensional virtual scene; this application does not limit the dimension of the virtual scene. For example, the virtual scene may include the sky, land, ocean, etc., and the land may include environmental elements such as deserts and cities. Users can control virtual objects to move within the virtual scene.

[0034] In one embodiment, in a virtual reality space, a user can perform related interactive operations by operating a device, such as a controller, for example, by pressing buttons on the controller. Alternatively, in another embodiment, gestures, voice, or multimodal control methods can be used to control the target object in the virtual reality device instead of a controller.

[0035] In some embodiments of this disclosure, the proposed control method can be used in virtual reality devices, which are terminals for realizing virtual reality effects. They can typically be provided in the form of glasses, head-mounted displays (HMDs), or contact lenses to achieve visual perception and other forms of perception. Of course, the form of virtual reality devices is not limited to these, and they can be further miniaturized or enlarged as needed.

[0036] The virtual reality devices described in this disclosure can include, but are not limited to, the following types:

[0037] PC-based virtual reality (PCVR) devices utilize a PC for calculations and data output related to virtual reality functions. External PC-based virtual reality devices then use the data output from the PC to achieve the virtual reality effect.

[0038] Mobile virtual reality devices support setting up mobile terminals (such as smartphones) in various ways (such as head-mounted displays with dedicated card slots). Through wired or wireless connections with the mobile terminal, the mobile terminal performs calculations related to virtual reality functions and outputs data to the mobile virtual reality device, such as watching virtual reality videos through a mobile terminal's app.

[0039] All-in-one virtual reality devices have a processor for performing virtual functions, thus possessing independent virtual reality input and output capabilities. They do not require connection to a PC or mobile terminal, offering a high degree of freedom of use.

[0040] Virtual reality devices can display virtual reality images in virtual reality space. The underlying layer of virtual reality devices often uses operating systems such as Android and iOS. However, the displayed virtual reality images cannot be directly touched. Therefore, the operation events performed through virtual reality images cannot be directly executed by the underlying system.

[0041] In some embodiments of this disclosure, extended reality can be AR (Augmented Reality): an AR scene refers to a simulated scene in which at least one virtual object is superimposed on a physical scene or its representation. For example, an electronic system may have an opaque display and at least one imaging sensor for capturing images or videos of the physical scene, which are representations of the physical scene. The system combines the images or videos with virtual objects and displays the combination on the opaque display. An individual uses the system to indirectly view the physical scene via images or videos of the physical scene and observes the virtual objects superimposed on the physical scene. When the system captures images of the physical scene using one or more image sensors and uses those images to present the AR scene on an opaque display, the displayed images are referred to as video pass-through. Alternatively, an electronic system for displaying an AR scene may have a transparent or semi-transparent display through which an individual can directly view the physical scene. The system may display virtual objects on the transparent or semi-transparent display, allowing an individual to observe virtual objects superimposed on the physical scene using the system. As another example, the system may include a projection system that projects virtual objects onto the physical scene. Virtual objects can be projected, for example, onto a physical surface or as holograms, allowing individuals to observe virtual objects superimposed on a physical setting using the system. Specifically, a technique involves calculating the camera's pose parameters in the real world (or 3D world, the real world) in real time during image acquisition, and adding virtual elements to the captured images based on these parameters. Virtual elements include, but are not limited to, images, videos, and 3D models. The goal of AR technology is to overlay the virtual world onto the real world on a screen for interactive experiences.

[0042] In some embodiments of this disclosure, extended reality can be MR (Mixed Reality): by presenting virtual scene information in a real-world setting, an interactive feedback loop is established between the real world, the virtual world, and the user to enhance the realism of the user experience. For example, computer-created sensory input (e.g., virtual objects) is integrated with sensory input or its representation from a physical setting in a simulated scene. In some MR scenes, computer-created sensory input can adapt to changes in sensory input from the physical setting. Additionally, some electronic systems used to present MR scenes can monitor orientation and / or position relative to the physical setting to enable virtual objects to interact with real objects (i.e., physical elements or their representations from the physical setting). For example, the system can monitor motion so that virtual plants appear stationary relative to physical buildings.

[0043] In some embodiments of this disclosure, after a user wears an augmented reality device, the device can acquire the surrounding real environment and present an image of that environment to the user. Alternatively, it can present an image of a virtual environment. After presenting the image, the environment within it can be calibrated. For example, the environment in the image may include a room and furniture, which can be calibrated separately. Virtual furniture provided by the augmented reality device can also be placed in the room, i.e., to decorate the space.

[0044] When calibrating a room, the extended reality device can prompt whether this is the first calibration or whether a previously stored calibration can be used. For the first calibration, calibration can be performed using the extended reality device's control mechanism (e.g., a controller). Figure 2 As shown, virtual prompts and options can be displayed on the control device within the extended reality space, such as... Figure 2 As shown, the prompts correspond to components on the control device, informing them of their functions. The option information is used to select whether the current operation is calibrating a space (room), calibrating furniture, or decorating the space. The function of the same component may differ depending on the selected option; therefore, the prompts can be related to the selected option.

[0045] like Figure 3 As shown, during spatial calibration, a tetrahedral cavity can be set up using control equipment as the calibration room. The extended reality device will automatically generate the walls and ceiling. The ceiling height can be changed by using the ray from the control equipment to move the ray. Figure 4 As shown, furniture can be calibrated within a designated room. This involves using the raycasting function of the control device to draw square components, such as generating a TV cabinet or sofa, and placing it in the selected location. Since users may not be able to see the real environment when using extended reality devices, a safe zone needs to be set up within the room. This involves selecting a portion of the ground as the safe zone, and providing a notification when the user leaves or reaches the edge of the safe zone.

[0046] like Figure 5 As shown, when decorating a space, the extended reality device displays two-dimensional images of several decorative items, such as... Figure 5 The upper right corner box offers options such as weather, clock, space, and photo frames for users to choose from. After an item is selected, before removing it from the display panel, the effect of the item detaching from the panel can be displayed. When the item is moved a certain distance away from the display panel, such as... Figure 6As shown, a three-dimensional image of the ornament can be generated, forming a three-dimensional preview display. When the selected ornament is moved, the three-dimensional image, as a virtual object, will move along with it. The user can place the virtual object in the desired position, such as on the bottom or on the wall, thereby forming an object in an extended real space.

[0047] In extended reality devices, virtual images of the real environment can be generated based on captured images of the surrounding environment. Users can perform spatial calibration based on these virtual images, causing the drawn walls to overlap with the walls in the real environment, thus achieving mixed reality. Similarly, virtual objects can be superimposed on furniture in the real environment. Of course, the walls drawn during spatial calibration can be completely virtual, and the objects can be non-overlapping with real furniture, forming completely virtual walls and furniture.

[0048] like Figure 7 As shown, Figure 7 This is a flowchart of a control method based on extended reality according to an embodiment of the present disclosure, which includes the following steps.

[0049] S11: Display a virtual clock in extended reality space.

[0050] In some embodiments, the extended reality space can be a purely virtual space or a hybrid space combining virtual and real spaces. The virtual space can be generated based on a real image of the user's environment. A virtual clock is used to display time. A dial can be displayed inside or on the surface of the virtual clock; the dial can be a digital dial or an analog dial to display the time.

[0051] S12: Determine the display position based on the current time to be displayed, and display the time at the display position.

[0052] In some embodiments, the display position is used to display time, and the display position is associated with the time displayed by the virtual clock. When the virtual clock displays time, the display position is determined according to the time that needs to be displayed, and the time is displayed at the display position. The display position can be the location of the dial, which can be located inside or on the surface of the virtual clock. In some embodiments, different times can be associated with different display positions, so as time passes, the position of the dial displayed by the virtual clock changes with the passage of time. In this way, the display position of the virtual clock can reflect the passage of time, realizing dynamic three-dimensional display. In related technologies, only changing time pointers or time numbers are displayed in a two-dimensional image. The display method is two-dimensional and lacks three-dimensional dimension. The displayed information is straightforward but lacks information dimension, which cannot meet the user's needs to view and use a stereoscopic three-dimensional clock in an extended reality space. The method proposed in this disclosure allows the display position to change accordingly when the displayed time changes, thereby realizing a three-dimensional dynamic display. In some embodiments, the virtual clock uses an analog dial, and the position of the entire analog dial changes as the time indicated by the pointer changes. In other embodiments, the virtual clock uses a digital dial, and the position of the entire digital dial changes as the time changes, or the hour and minute counts can change their display positions as their respective displayed numbers change.

[0053] In some embodiments of this disclosure, determining the display position based on the current time to be displayed includes: determining the display position based on the current time to be displayed and the function of the virtual clock; wherein the virtual clock has at least two functions, and the display position is different when the functions of the virtual clock are different.

[0054] In some embodiments, the virtual clock can have at least two functions. For example, a virtual clock can have a clock function, as well as at least one of a countdown function or a timer function. Different functions may require displaying time; for example, countdown and timer functions require displaying both countdown and timer durations. The display position can differ for different functions. For example, for the clock function, the time display position can move along a first direction as time changes, such as a horizontal direction. For the countdown function, the time display position can move along a second direction as time changes, such as a vertical direction from top to bottom, thus indicating the remaining time through the height of the time display position. For the timer function, the time display position can move along a third direction as time changes, such as a vertical direction from bottom to top, thus indicating the accumulation of time through the height of the display position. In some embodiments, the direction of movement of the time display position is associated with the function; the direction of movement of the time display position can differ for different functions of the virtual clock.

[0055] In some embodiments of this disclosure, in response to the virtual clock being picked up, the current posture of the virtual clock is determined, and the current function of the virtual clock is determined based on the current posture and a pre-set correspondence between posture and function; in response to the virtual clock being put down, the function of the virtual clock is set as the current function, and the function content displayed by the clock object is controlled based on the current function of the virtual clock. In some embodiments, the function of the virtual clock is related to its posture. When the virtual clock is picked up, the current posture of the virtual clock is detected, and then a function corresponding to the current posture is determined as the current function. Then, the content displayed by the virtual clock is switched to the content corresponding to the current function. In this way, the displayed content can be changed by changing the posture of the virtual clock.

[0056] In some embodiments of this disclosure, displaying a virtual clock in an extended reality space includes: presenting a display panel in the extended reality space, the display panel displaying at least one ornament image, the ornament image including an image of a virtual clock; generating a three-dimensional virtual clock and controlling the virtual clock to move according to the movement operation in response to a movement operation after the image of the virtual clock is selected; and displaying the virtual clock at the target location in response to moving the virtual clock to a target location.

[0057] In some embodiments, reference may be made to Figure 5 and Figure 6In the extended reality space, a display panel is first presented, showing an image of a virtual clock. This image can be either two-dimensional or three-dimensional. Taking a two-dimensional image as an example, the user can select the virtual clock image using a control device such as a gamepad, and then drag the image off the display panel. This will present a three-dimensional virtual clock as a preview. Once the three-dimensional virtual clock is placed at the target location, it will be displayed as a full-fledged virtual clock. In this embodiment, the virtual clock is displayed and dragged in a three-dimensional form, improving the user's interactive experience.

[0058] In some embodiments of this disclosure, the display style of the hours in the virtual clock differs from the display style of the minutes. In some embodiments, the virtual clock employs a different display style than... Figure 8 The digital dial shown can display the hours and minutes in different fonts, with the hour font being thicker than the minute font. The hour numerals can also be a different color than the minute numerals, using these differences in display style to provide a deeper interpretation of the time display. In some embodiments, the hours are displayed in bold, while the minutes are displayed in non-bold font for distinction, making the visual effect more recognizable and aesthetically pleasing. This utilizes visual difference to differentiate the information.

[0059] In some embodiments of this disclosure, the hours and minutes displayed by the virtual clock are located on two different display planes. In some embodiments, the plane displaying the hours and the plane displaying the minutes may not be the same plane; the two planes may be parallel to each other. For example... Figure 9 As shown, two planes are displayed: one for displaying hours and one for displaying minutes. These two planes can be independent of each other. The plane displaying the hours can be a first plane (hour plane), and the plane displaying the minutes can be a second plane (minute plane). The first plane can be a 700px × 700px plane, displaying numbers on it. The overall thickness of the first plane is 0, but the thickness of the hours displayed on it is not zero, for example, not less than 1cm, thus creating a three-dimensional effect. A colon is displayed between the first and second planes. The second plane can also be a 700×700px plane, with the thickness of the minutes displayed on it not being zero, for example, not less than 1cm. The first and second planes are spaced apart in a direction parallel to each other, with a spacing of 90px. The first and second planes can be vertical planes.

[0060] In some embodiments of this disclosure, the display position moves in a direction parallel to a preset direction as the time displayed by the virtual clock changes. In some embodiments, such as... Figure 10As shown, the preset direction can be perpendicular to the plane displaying the time. For example, if the plane used to display the time is vertical, the preset direction can be horizontal. The display position of the time can move between two vertical planes before and after the virtual clock. For example, the first and second surfaces of the virtual clock are two vertical planes facing away from each other in the preset direction. The displayed time moves between the first and second surfaces. The smaller the displayed time value, the closer it is to the first surface; the larger the displayed time value, the closer it is to the second surface. Thus, the user can perceive the passage of time based on the position of the displayed time. The display position can start from the first surface and move towards the second surface according to the currently displayed time to represent the passage of time and the state of the current time within a whole day. The thickness of the entire virtual clock in the preset direction can be divided into equal parts according to the time, and the position of the display between the first and second surfaces can be calculated based on the displayed time.

[0061] In some embodiments of this disclosure, the displayed time includes hours and minutes, and the display position includes a first plane for displaying hours and a second plane for displaying minutes; the position of the first plane changes with the number of hours, and / or the position of the second plane changes with the number of minutes.

[0062] In some embodiments, please refer to Figure 10 In this embodiment of the disclosure, the hours and minutes are displayed on a first plane and a second plane, respectively. The position of the first plane can change according to the hours it displays, so that the hours ( Figure 10 The position of 02 in 02:35 is not fixed and will move as the number changes. Similarly, the position of the second plane can change with the number of minutes it displays, so that the number of minutes ( Figure 10 The position of 35 in 02:35 is not fixed and will move as the number changes. In this embodiment of the disclosure, the positions of the first plane and the second plane containing the hours and minutes can change independently as their respective displayed numbers change, realizing a three-dimensional dynamic display of time.

[0063] In some embodiments of this disclosure, the virtual clock has a start surface and an end surface in a preset direction, and the start surface and the end surface are each independently located on or inside the surface of the virtual clock. The start surface and the end surface can be two surfaces of the virtual clock that are opposite to each other in the preset direction.

[0064] Determining the display position based on the current time to be displayed includes: determining the position of a first plane between a start plane and an end plane based on the ratio of hours to hours in a day; and / or determining the position of a second plane between a start plane and an end plane based on the ratio of minutes to minutes in an hour.

[0065] In some embodiments, such as Figure 10 As shown, when determining the position of the first plane, the width of the starting and ending planes in a preset direction can be divided into 24 equal parts. The position of the first plane is calculated based on the number of hours of the currently displayed time. Specifically, the position of the first plane can be calculated as follows: the ratio of the number of hours to 24 is multiplied by the length of the starting and ending planes in the preset direction to obtain a first translation distance. This first translation distance, calculated by moving from the starting plane to the ending plane, is used as the position of the first plane, which is parallel to the starting and ending planes. A similar method can be used to determine the position of the second plane representing the number of minutes of the current time. First, the ratio of the number of minutes to 60 minutes in an hour is calculated, then multiplied by the length of the starting and ending planes in the preset direction to obtain a second translation distance. This second translation distance, calculated by moving from the starting plane to the ending plane, is used as the position of the second plane, which is also parallel to the starting and ending planes. The number of hours and minutes are spaced apart in a direction parallel to both the first and second planes. In some embodiments of this disclosure, the positions of the first and second planes are moved separately, thereby utilizing visual effects and spatial differences to provide a deeper interpretation of the time display.

[0066] The positions of the first and second planes within the virtual clock move from the starting plane to the ending plane as time flows. This spatial relationship represents the passage of time. The spatial relationship between the two planes within the component represents the current time within a whole day, allowing users to identify the current time in the virtual space simply by using the spatial position information of the first and second planes.

[0067] In some embodiments of this disclosure, displaying a virtual clock in an extended reality space includes: displaying a transparent or semi-transparent three-dimensional container as a virtual clock, and displaying the time within the three-dimensional container. In some embodiments, such as Figure 10 As shown, the virtual clock simulates the material and visual experience of glass with a certain reflective effect through modeling, achieving a combination of decorative and practical effects.

[0068] In some embodiments of this disclosure, the method further includes: displaying a first animation inside or on the surface of the virtual clock in response to it being picked up. In some embodiments, a second animation is displayed inside or on the surface of the virtual clock in response to it being put down. In some embodiments, the virtual clock is modeled as a semi-transparent container, such as a semi-transparent glass box, and a first animation, for example, changes color, occurs when the user picks up the virtual clock. A second animation, for example, restores the color change, occurs when the user puts down the virtual clock. The first animation may be accompanied by sound effects, which may play the current time. The virtual clock may be set with an alarm, and the second animation may also include sound effects, which may play the next alarm time.

[0069] In some embodiments of this disclosure, based on extended reality technology, a three-dimensional virtual clock with extended reality is provided to the user, offering a brand-new visual effect. By adapting spatial information to the passage of time, the clock not only represents the location of the current event within a day using positional relationships, but also provides a deeper layer of information, providing the user with a clock design that is easier to identify.

[0070] Some embodiments of this disclosure also propose a control device based on extended reality, including:

[0071] A display unit is used to display a virtual clock in an extended reality space, wherein the virtual clock is used to display time;

[0072] The control unit determines the display position based on the current time to be displayed, and displays the time at the display position.

[0073] The display position is associated with the time displayed by the virtual clock.

[0074] In some embodiments, determining the display position based on the current time to be displayed includes: determining the display position based on the current time to be displayed and the function of the virtual clock; wherein the virtual clock has at least two functions, and the display position is different when the functions of the virtual clock are different.

[0075] In some embodiments, displaying a virtual clock in extended reality includes: presenting a display panel in extended reality, the display panel displaying at least one ornament image, the ornament image including an image of a virtual clock; generating a three-dimensional virtual clock and controlling the virtual clock to move according to the movement operation in response to a movement operation after the image of the virtual clock is selected; and displaying the virtual clock at the target location in response to moving the virtual clock to a target location.

[0076] In some embodiments, the display style of the hours displayed by the virtual clock is different from that of the minutes; in some embodiments, the hours and minutes displayed by the virtual clock are located on two different display planes.

[0077] In some embodiments, the display position moves in a direction parallel to a preset direction as the time displayed by the virtual clock changes.

[0078] In some embodiments, the displayed time includes hours and minutes, and the display location includes a first plane for displaying the hours and a second plane for displaying the minutes;

[0079] The position of the first plane changes with the number of hours, and / or the position of the second plane changes with the number of minutes.

[0080] In some embodiments, the virtual clock has a start surface and an end surface in a preset direction;

[0081] The display position is determined based on the current time to be displayed, including:

[0082] The position of the first plane is determined between the starting plane and the ending plane based on the ratio of the number of hours to the total number of hours in a day; and / or,

[0083] The position of the second plane is determined between the starting plane and the ending plane based on the ratio of the number of minutes to the number of minutes in an hour.

[0084] In some embodiments, displaying a virtual clock in extended reality space includes: displaying a transparent or semi-transparent three-dimensional container as the virtual clock, and displaying the time in the three-dimensional container.

[0085] In some embodiments, the display unit is further configured to display a first animation inside or on the surface of the virtual clock in response to the virtual clock being picked up; and / or, to display a second animation inside or on the surface of the virtual clock in response to the virtual clock being put down.

[0086] For embodiments of the apparatus, since they basically correspond to the method embodiments, relevant details can be found in the descriptions of the method embodiments. The apparatus embodiments described above are merely illustrative, and the modules described as separate modules may or may not be separate. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0087] The methods and apparatus of this disclosure have been described above based on embodiments and application examples. Furthermore, this disclosure also provides an electronic device and a computer-readable storage medium, which are described below.

[0088] The following is for reference. Figure 11The figure illustrates a structural schematic of an electronic device (e.g., a terminal device or server) 800 suitable for implementing embodiments of the present disclosure. The terminal device in the embodiments of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. The electronic device shown in the figure is merely an example and should not be construed as limiting the functionality and scope of the embodiments of the present disclosure.

[0089] Electronic device 800 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 801, which can perform various appropriate actions and processes according to a program stored in read-only memory (ROM) 802 or a program loaded from storage device 808 into random access memory (RAM) 803. RAM 803 also stores various programs and data required for the operation of electronic device 800. The processing device 801, ROM 802, and RAM 803 are interconnected via bus 804. Input / output (I / O) interface 805 is also connected to bus 804.

[0090] Typically, the following devices can be connected to I / O interface 805: input devices 806 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 807 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 808 including, for example, magnetic tapes, hard disks, etc.; and communication devices 809. Communication device 809 allows electronic device 800 to communicate wirelessly or wiredly with other devices to exchange data. Although an electronic device 800 with various devices is shown in the figure, it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0091] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 809, or installed from a storage device 808, or installed from a ROM 802. When the computer program is executed by a processing device 801, it performs the functions defined in the methods of embodiments of this disclosure.

[0092] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0093] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol, such as HTTP (Hypertext Transfer Protocol), and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.

[0094] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0095] The aforementioned computer-readable medium carries one or more programs, which, when executed by the electronic device, cause the electronic device to perform the methods of the present disclosure.

[0096] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0097] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0098] The units described in the embodiments of this disclosure can be implemented in software or hardware. The names of the units are not, in some cases, intended to limit the specific unit.

[0099] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0100] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0101] According to one or more embodiments of this disclosure, a control method based on extended reality is provided, comprising:

[0102] A virtual clock is displayed in an extended reality space, wherein the virtual clock is used to display time;

[0103] The display position is determined based on the current time to be displayed, and the time is displayed at that position.

[0104] The display position is associated with the time displayed by the virtual clock.

[0105] According to one or more embodiments of this disclosure, a control method based on extended reality is provided, which determines the display position based on the current time to be displayed, including:

[0106] The display position is determined based on the current time to be displayed and the function of the virtual clock;

[0107] The virtual clock has at least two functions, and the display position is different depending on the function of the virtual clock.

[0108] According to one or more embodiments of this disclosure, a control method based on extended reality is provided to display a virtual clock in an extended reality space, including:

[0109] A display panel is presented in an extended reality space, the display panel displaying at least one ornament image, the ornament image including an image of a virtual clock;

[0110] In response to a movement operation after the image of the virtual clock is selected, a three-dimensional virtual clock is generated and the virtual clock is controlled to move according to the movement operation;

[0111] In response to moving the virtual clock to a target location, the virtual clock is displayed at the target location.

[0112] According to one or more embodiments of this disclosure, a control method based on extended reality is provided, satisfying at least one of the following:

[0113] The virtual clock displays hours in a different style than it displays minutes.

[0114] The hours and minutes displayed by the virtual clock are located on two different display planes.

[0115] According to one or more embodiments of this disclosure, a control method based on extended reality is provided, wherein the display position moves in a direction parallel to a preset direction as the time displayed by the virtual clock changes.

[0116] According to one or more embodiments of this disclosure, a control method based on extended reality is provided, wherein the displayed time includes hours and minutes, and the display position includes a first plane for displaying the hours and a second plane for displaying the minutes;

[0117] The position of the first plane changes with the number of hours, and / or the position of the second plane changes with the number of minutes.

[0118] According to one or more embodiments of this disclosure, a control method based on extended reality is provided, wherein the virtual clock has a start surface and an end surface in a preset direction;

[0119] The display position is determined based on the current time to be displayed, including:

[0120] The position of the first plane is determined between the starting plane and the ending plane based on the ratio of the number of hours to the total number of hours in a day; and / or,

[0121] The position of the second plane is determined between the starting plane and the ending plane based on the ratio of the number of minutes to the number of minutes in an hour.

[0122] According to one or more embodiments of this disclosure, a control method based on extended reality is provided to display a virtual clock in an extended reality space, including:

[0123] A transparent or semi-transparent three-dimensional container is displayed as the virtual clock, and the time is displayed in the three-dimensional container.

[0124] According to one or more embodiments of this disclosure, a control method based on extended reality is provided, further comprising:

[0125] In response to the virtual clock being picked up, a first animation is displayed inside or on the surface of the virtual clock; and / or,

[0126] In response to the virtual clock being placed down, a second animation is displayed inside or on the surface of the virtual clock.

[0127] According to one or more embodiments of this disclosure, a control device based on extended reality is provided, comprising:

[0128] A display unit is used to display a virtual clock in an extended reality space, wherein the virtual clock is used to display time;

[0129] The control unit is configured to determine the display position based on the current time to be displayed, and display the time at the display position.

[0130] The display position is associated with the time displayed by the virtual clock.

[0131] According to one or more embodiments of the present disclosure, an electronic device is provided, including: at least one memory and at least one processor;

[0132] The at least one memory is used to store program code, and the at least one processor is used to call the program code stored in the at least one memory to execute the method described in any one of the above.

[0133] According to one or more embodiments of the present disclosure, a computer-readable storage medium is provided for storing program code that, when executed by a processor, causes the processor to perform the methods described above.

[0134] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.

[0135] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.

[0136] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.

Claims

1. A control method based on extended reality, characterized in that, include: A virtual clock is displayed in an extended reality space, wherein the virtual clock is used to display time; The display position is determined based on the current time to be displayed, and the time is displayed at that position. The display position is associated with the time displayed by the virtual clock; The displayed time includes hours and minutes, and the display position includes a first plane for displaying the hours and a second plane for displaying the minutes; The position of the first plane changes with the number of hours, and / or the position of the second plane changes with the number of minutes.

2. The method according to claim 1, characterized in that, The display position is determined based on the current time to be displayed, including: The display position is determined based on the current time to be displayed and the function of the virtual clock; The virtual clock has at least two functions, and the display position is different depending on the function of the virtual clock.

3. The method according to claim 1, characterized in that, Displaying a virtual clock in extended reality includes: A display panel is presented in an extended reality space, the display panel displaying at least one ornament image, the ornament image including an image of a virtual clock; In response to a movement operation after the image of the virtual clock is selected, a three-dimensional virtual clock is generated and the virtual clock is controlled to move according to the movement operation; In response to moving the virtual clock to a target location, the virtual clock is displayed at the target location.

4. The method according to claim 1, characterized in that, It satisfies at least one of the following: The virtual clock displays hours in a different style than it displays minutes. The hours and minutes displayed by the virtual clock are located on two different display planes.

5. The method according to claim 1, characterized in that, The display position moves in a direction parallel to a preset direction as the time displayed by the virtual clock changes.

6. The method according to claim 1, characterized in that, The virtual clock has a start surface and an end surface in a preset direction; The display position is determined based on the current time to be displayed, including: The position of the first plane is determined between the starting plane and the ending plane based on the ratio of the number of hours to the total number of hours in a day; And / or, The position of the second plane is determined between the starting plane and the ending plane based on the ratio of the number of minutes to the number of minutes in an hour.

7. The method according to claim 1, characterized in that, Displaying a virtual clock in extended reality includes: A transparent or semi-transparent three-dimensional container is displayed as the virtual clock, and the time is displayed in the three-dimensional container.

8. The method according to claim 1, characterized in that, Also includes: In response to the virtual clock being picked up, a first animation is displayed inside or on the surface of the virtual clock; And / or, In response to the virtual clock being placed down, a second animation is displayed inside or on the surface of the virtual clock.

9. A control device based on extended reality, comprising: A display unit is used to display a virtual clock in an extended reality space, wherein the virtual clock is used to display time; The control unit is configured to determine the display position based on the current time to be displayed, and display the time at the display position. The display position is associated with the time displayed by the virtual clock; The displayed time includes hours and minutes, and the display position includes a first plane for displaying the hours and a second plane for displaying the minutes; the position of the first plane changes with the number of hours, and / or the position of the second plane changes with the number of minutes.

10. An electronic device, comprising: At least one memory and at least one processor; The at least one memory is used to store program code, and the at least one processor is used to call the program code stored in the at least one memory to execute the method of any one of claims 1 to 8.

11. A computer-readable storage medium for storing program code that, when executed by a processor, causes the processor to perform the method of any one of claims 1 to 8.

Images