Display control method and device, electronic equipment and storage medium

Abstract

The invention provides a display control method and device, electronic equipment and a storage medium. According to the display control method, a display unit and a processing unit are in communication connection, a user can view a real environment through the display unit, and the method comprises the steps that the display unit displays a user interface, and the user interface comprises an image of the real environment presented through the display unit and target information generated by the processing unit; and in response to rotation of the head of the user in the first rotation direction, controlling the target information to rotate in the user interface in a direction opposite to the first rotation direction relative to the head. In some embodiments of the invention, the use experience of a user is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a display control method, device, electronic device and storage medium. Background Art

[0002] In the mixed reality world, images of the real environment and some display information generated by calculation can be displayed, and the display information can be displayed in 0 degrees of freedom, 3 degrees of freedom, and 6 degrees of freedom. When displayed with 0 degrees of freedom, the display information may not be fixed in the extended reality world, so that it rotates and moves completely in accordance with the rotation and movement of the user's head; when displayed with 3 degrees of freedom, the display information may move with the movement of the user's head, but the display information does not rotate with the rotation of the user's head, and is relatively fixed in the extended reality space; when displayed with 6 degrees of freedom, the display information may be fixed in the extended reality world and does not follow the movement and rotation of the user's head. Summary of the invention

[0003] The present disclosure provides a display control method, device, electronic device and storage medium.

[0004] The present disclosure adopts the following technical solutions.

[0005] In some embodiments, the present disclosure provides a display control method, wherein a display unit and a processing unit are communicatively connected, and a user can view a real environment through the display unit, and the method includes:

[0006] The display unit displays a user interface, which includes: an image of a real environment presented by the display unit and display target information generated by the processing unit;

[0007] In response to the user's head rotating in a first rotation direction, the target information is controlled to rotate in the user interface in a direction opposite to the first rotation direction of the head.

[0008] In some embodiments, the present disclosure provides a display control device, including:

[0009] A processing unit, used for generating target information, a display unit and the processing unit are in communication connection, and a user can view the real environment through the display unit;

[0010] A display unit, used to display a user interface, the user interface including: an image of a real environment presented by the display unit and target information generated by the processing unit;

[0011] The control unit is used for controlling the target information to rotate in the opposite direction of the user's head along the first rotation direction in response to the user's head rotating along the first rotation direction.

[0012] In some embodiments, the present disclosure provides an electronic device, comprising: at least one memory and at least one processor;

[0013] The memory is used to store program codes, and the processor is used to call the program codes stored in the memory to execute the above method.

[0014] In some embodiments, the present disclosure provides a computer-readable storage medium, wherein the computer-readable storage medium is used to store program code, and when the program code is executed by a processor, the processor is prompted to perform the above method.

[0015] The display control method provided by the embodiment of the present disclosure displays an image of a real environment and target information on a user interface; in response to the user's head rotating along a first rotation direction, the target information is controlled to rotate in the user interface in a direction opposite to the first rotation direction of the head. In some embodiments of the present disclosure, the problem of low user experience in a 0-degree-of-freedom display mode is solved. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that components and elements are not necessarily drawn to scale.

[0017] Figure 1 A schematic diagram of using a mixed reality device according to an embodiment of the present disclosure.

[0018] Figure 2 is a flow chart of a display control method according to an embodiment of the present disclosure.

[0019] Figures 3 to 6 Schematic diagram of target information and users according to an embodiment of the present disclosure.

[0020] Figure 7 It is a schematic diagram of the structure of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0021] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0022] It should be understood that the various steps described in the method embodiments of the present disclosure can be performed in sequence and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0023] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

[0024] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0025] It should be noted that the modification of “one” mentioned in the present disclosure is illustrative rather than restrictive, and those skilled in the art should understand that it should be understood as “one or more” unless otherwise clearly indicated in the context.

[0026] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0027] The solution provided by the embodiment of the present disclosure will be described in detail below with reference to the accompanying drawings.

[0028] refer to Figure 1 A user can enter a mixed real space through a mixed reality device such as AR glasses. The mixed real space includes an image of the real environment that can be viewed through the AR glasses, and display information (such as target information) calculated and generated by a processing unit can be displayed on the display unit (such as lenses) of the AR glasses, such as virtual graphics or text. The combination of the image of the real environment and the display information generated by calculation realizes the mixing of virtual and reality.

[0029] The mixed reality device is provided with a posture detection sensor (such as a nine-axis sensor) for detecting posture changes of the mixed reality device in real time. If the user wears the mixed reality device, then when the user's head posture changes, the real-time posture of the head will be transmitted to the processor to calculate the user's gaze point in the mixed reality space environment, and the image in the user's gaze range (i.e., virtual field of view) in the mixed reality space environment is calculated based on the gaze point and displayed on the display unit, giving people an immersive experience as if they were watching in a real environment.

[0030] In the mixed reality world, when the display information adopts a 0-degree-of-freedom display method, the display information may not be fixed in the mixed reality world, so that it can completely rotate and move with the user. At this time, when the user looks at an object in the extended reality world, because the user usually does not simply turn the eyeballs, but uses the coordination of the head and eyeballs to complete it, and when the user wears an extended display device, based on the 0-degree-of-freedom display method, when the user turns his head to look at the display information (such as target information) that was not originally located in the middle of the field of vision, the mixed reality device will control the display information to rotate with the user's head so that the relative position of the display information and the user's head remains unchanged. Therefore, when the user turns his head, the display information cannot enter the middle of the field of vision, and the user will keep turning his head to chase the display information, resulting in a decrease in the user experience. If the display information is fixed in the middle of the user's field of vision, although it can avoid turning the head to chase the display information, this will cause the display information to block the user's field of vision. When the user views the real environment through the display unit of the mixed reality device, the image of the real environment will be blocked by the display information, and focus will be hindered, which will also cause inconvenience. Therefore, the display information that needs to be always displayed in the user's field of vision should usually be placed in the edge area of ​​the user's field of vision, avoiding the middle of the field of vision to avoid blocking the image of the real environment. Moreover, in the real world, there are usually no objects with 0 degrees of freedom display mode. When users look at the 0 degrees of freedom display information in the extended real world, they are prone to dizziness.

[0031] like Figure 2 As shown, Figure 2 is a flow chart of a display control method according to an embodiment of the present disclosure, comprising the following steps.

[0032] S11. The display unit displays a user interface, which includes: an image of a real environment presented by the display unit and target information generated by the processing unit.

[0033] In some embodiments, the display unit and the processing unit are connected in communication, and the user can view the real environment through the display unit. The method proposed in the present disclosure can be used for mixed reality devices, such as AR glasses. The display unit can be a lens of AR glasses, and the display unit can be semi-transparent. After the user wears the mixed reality device, the user can see the image of the real environment through the display unit. The target information is the information generated by the processing unit. The processing unit can specifically be a processing unit in the mixed reality device, or a processing unit of other devices other than the mixed reality device. It can be a processor with a computing function, which is used to generate the target information. Specifically, taking the processing unit as a processor of the mixed reality device as an example, when the user wears the mixed reality device, the display unit is blocked in front of the user's eyes, so the display unit needs to be able to display the image of the real environment through it to avoid the user's realization being blocked. The processing unit can calculate and generate the target information based on the user's settings or the system's default settings, and then transmit it to the display unit for display. The target information can be displayed on the display unit by, for example, projection, etc., and mixed with the image of the presented real environment to form a mixed reality image. The user interface is the image presented by the user on the display unit, specifically including the image of the real environment seen by the user through the display unit and the target information generated by the computing unit. The target information may be text or a picture, for example, a description or introduction of an object in an image of a real environment. A user wearing a mixed reality device may view the target information. The target information may be displayed in a user interface, and the user interface is in the user's field of view. The target information may not be located in the middle of the field of view.

[0034] S12. In response to the user's head rotating along a first rotation direction, control the target information in the user interface to rotate in a direction opposite to the first rotation direction of the head.

[0035] In some embodiments, a motion sensor may be included in the mixed reality device to detect the movement of the head of the user wearing the mixed reality device. The first rotation direction may be, for example, upward, downward, left, or right. During the rotation of the user's head, the target information will be controlled to rotate relative to the head in a direction opposite to the first rotation direction as the user's head rotates. For example, if the user's head rotates upward, the target information will rotate downward in the user interface. In this way, when the target information is not displayed in the middle of the user's field of view, the user can move the target information to the middle of the field of view by turning the head, making it easier for the user to view the target information.

[0036] In some embodiments of the present disclosure, in the scenario of using a mixed reality device, the display unit will block the user's eyes. Since the user can see the real environment through the display unit, it will not affect the user's normal activities in the real environment. The target information is displayed on the user interface presented by the display unit. In order to prevent the target information from blocking the user's field of view, the target information is usually not located in the middle area of ​​the user interface. The user will subconsciously turn his head to view the target information. In this embodiment, when the user's head rotates along a first rotation direction, the target information can rotate relative to the head in the opposite direction of the first rotation direction, so that the target information can be moved to the position desired by the user in the target interface for the user to view, thereby improving the user's experience.

[0037] In some embodiments of the present disclosure, a preset boundary is pre-set. When the head rotates along a first rotation direction, the target information rotates in the opposite direction of the first rotation direction relative to the head. If the target information rotates in the opposite direction of the first rotation direction relative to the head to the preset boundary in the user interface, the position of the target information in the user interface is controlled to be different. At this time, the relative position of the target information and the head remains unchanged, so that the target information rotates along the first rotation direction with the head. When the target information rotates to the preset boundary, it will no longer rotate relative to the head, but rotate with the head. At this time, in the extended real world, the target information and the head rotate in the same rotation direction and at the same speed. In the user's view, the target information is fixed relative to the user.

[0038] In some embodiments of the present disclosure, the proposed method is applicable to the scenario where the target information rotates with the rotation of the user. When the angle of the user's head rotation is large, the target information roughly rotates synchronously in the same direction as the rotation of the head; when the angle of the user's head rotation is small, the target information will rotate relative to the head. Therefore, when the user tries to chase the target information by, for example, raising his head, the motion sensor detects the rotation of the user's head, and rotates the target information in the opposite direction relative to the head (it can rotate in the opposite direction of the first rotation direction to the same angle as the head) to adapt to the user's line of sight so as to better view the target information. In this way, when the target information is located in an area outside the middle of the user's field of vision, the target information can be located in the middle of the field of vision by rotating the head. When the rotation angle is large, the target information reaches the preset boundary and will no longer rotate, preventing the target information from leaving the user.

[0039] In some embodiments of the present disclosure, the target information moves with the movement of the user's head; before and after the movement of the head, the relative position of the target information and the head remains unchanged. In some embodiments of the present disclosure, the target information is not fixed in the extended real world, so as to move with the user.

[0040] In some embodiments of the present disclosure, the target information is always located in the user interface currently displayed to the user, and the preset boundary is the boundary of the preset range in the user interface. In some embodiments, the target information is always displayed in the user interface, and the user interface is within the field of view of the current user, so the target information is always within the field of view of the user when the user turns his head. In order to ensure that the display of the target information cannot be moved away indefinitely due to the rotation of the head, a fixed range is set in the user interface. When the target information rotates to the boundary of the preset range, it will no longer rotate relative to the head, but will rotate synchronously with the head.

[0041] In some embodiments of the present disclosure, before responding to the user's head turning, it also includes: responding to a calibration operation, calibrating a default angle based on the current spatial angle information of the display unit; the default angle is used to determine whether the user's head has turned. In some embodiments, the user can perform a calibration operation to determine a default angle, and the default angle (for example, the orientation angle in the horizontal and vertical directions) is determined by detecting the spatial angle information through a posture detection component such as a gyroscope. When the display unit is at the default angle, it indicates that the user has not turned his head. When the control angle information of the display unit changes, it indicates that the user's head has turned.

[0042] In some embodiments, calibrating the default angle includes: calibrating the default pitch angle of the user's head; and / or calibrating the default horizontal angle of the user's head. In some embodiments, it is necessary to set a default angle of the user's head in a natural state. As a reference, the default pitch angle can be the angle between the user's direction when the user does not raise or lower his head in the vertical up and down directions and the horizontal plane. It can be the most comfortable angle for the user to place his head in daily life. It is used as a reference to determine whether the user has raised or lowered his head. If the angle of the user's head in the vertical direction is greater than the default pitch angle, it is considered that the user is raising his head, and the target information will move downward relative to the user's head, otherwise it will move upward. The default horizontal angle refers to the angle between the direction of the user when he does not turn his head in the horizontal direction and the default horizontal direction. For example, the default horizontal direction is the east, and the angle between the direction in the horizontal direction and the east when the head is not turned is the default horizontal angle, which is used as a reference to determine whether the user has turned his head in the horizontal direction.

[0043] In some embodiments of the present disclosure, the method further includes: after the rotation of the head and the target information is completed, the current horizontal angle of the user is used as the default horizontal angle. In some embodiments, the user usually does not face a horizontal direction. For example, the user just faces the east and then turns to the west. When the user completes the rotation to the west, the angle facing the west is used as the default horizontal angle to continue to determine whether the head has been rotated. Therefore, after the rotation is completed, the current horizontal angle of the user after the rotation is completed is used as the default horizontal angle. The current horizontal angle refers to the angle between the horizontal direction and the default horizontal direction.

[0044] In some embodiments of the present disclosure, the method further includes: after the rotation of the head and the target information is completed, controlling the location of the target information so that the relative position of the target information and the head remains unchanged before and after the head rotates along the first rotation direction. In some embodiments, the relative position of the target information and the user's head will only change during the rotation of the user's head, and the relative position of the target information and the user's head will remain unchanged before and after the user rotates. For example, the target information can always be displayed at a position above the user's time limit by a preset distance. Therefore, after the target information rotates to the preset boundary, the position of the target information will be restored after the user rotates.

[0045] In some embodiments of the present disclosure, in response to the user's head rotating in the first rotation direction, the target information is located outside the middle area of ​​the user interface displayed by the display unit. The user interface is presented in front of the user's eyes, and the target information should not block the user's field of vision, so that the user cannot see the external environment. The middle of the user interface is the middle of the user's field of vision in a normal state, and the target information is not located in the middle of the user interface by default, so that the target information will not block the middle of the user's field of vision.

[0046] In some embodiments of the present disclosure, the problem of insufficient user experience when using a 0-DOF display mode can be solved. In a 0-DOF display mode, if the target information is displayed in the middle of the user's field of view, it will block other objects. If it is displayed outside the middle of the user's field of view, for example, above the middle of the field of view, when the user looks up to view it, the relative position of the target information and the user's head will automatically remain unchanged. Therefore, the user cannot view the target information by looking up, causing inconvenience in use. In some embodiments of the present disclosure, reference Figures 3 to 5 ,The user wears the hybrid display device and calibrates the default pitch angle, e.g. Figure 3 This is the default pitch angle, target information ( Figure 3The target information is displayed at a preset distance above the middle of the user's field of vision. For example, when the user turns his head up and down in the vertical direction, such as looking up, when the user's head rotation angle is less than the threshold, the user's head turns upward, so the target information turns downward relative to the user's head in the user's field of vision (see Figure 4 ), so that the user can easily read the target information. When the user's head rotation angle reaches a threshold, the target information reaches a preset boundary of a preset range in the user interface (such as Figure 5 In the vertical direction, the preset range is the area defined in the user interface by two inclined planes that form an angle of 13 degrees with the horizontal direction). At this time, the target information will remain stationary relative to the head. If the user continues to look up, the target information will rotate together. In the embodiment of the present disclosure, in the application scenario of mixed reality, the display of target information is coordinated with the motion sensor of the mixed reality device. According to the rotation of the user's head, the display of target information is compensated for by rotation, so that the target information can be rotated to the middle of the user's field of view, solving the problem that the user's line of sight cannot capture the target information in the display mode of 0 degrees of freedom. And the preset boundary of the preset range is set to ensure that the target information is always displayed within the user's field of view. The default pitch angle in the natural state is calibrated to reduce the user's dizziness.

[0047] In some embodiments of the present disclosure, a display control device is also provided, including:

[0048] A processing unit, used for generating target information, a display unit and the processing unit are in communication connection, and a user can view the real environment through the display unit;

[0049] A display unit, used to display a user interface, wherein the user interface includes: an image of a real environment presented by the display unit and display target information generated by the processing unit;

[0050] a control unit, configured to control the target information to rotate in the user interface in a direction opposite to the direction of rotation of the head along the first rotation direction in response to the head of the user rotating along the first rotation direction;

[0051] Wherein, during the process of the head rotating along the first rotation direction, if the target information rotates to a preset boundary relative to the direction opposite to the first rotation direction of the head, the relative position of the target information and the head is controlled to remain unchanged.

[0052] In some embodiments, during the rotation of the head along a first rotation direction, if the target information rotates to a preset boundary in the user interface relative to the direction opposite to the first rotation direction of the head, the position of the target information in the user interface is controlled to remain unchanged.

[0053] In some embodiments, the target information moves as the user's head moves;

[0054] Before and after the movement of the head, the relative position of the target information and the head remains unchanged.

[0055] In one embodiment, the target information is always located in a user interface currently displayed to the user, and the preset boundary is a boundary of a preset range in the user interface.

[0056] In some embodiments, before responding to the user's head rotating along a first rotation direction, the control unit is also used to: in response to a calibration operation, calibrate a default angle based on the current spatial angle information of the display unit; the default angle is used to determine whether the user's head rotates.

[0057] In some embodiments, calibrating the default angle includes:

[0058] calibrating a default pitch angle of the user's head; and / or,

[0059] The default horizontal angle of the user's head is calibrated.

[0060] In some embodiments, the control unit is further used to: after the head and the target information rotate, control the position of the target information so that the relative position of the target information and the head remains unchanged before and after the head rotates along the first rotation direction.

[0061] In some embodiments, before the user's head rotates in a first rotation direction, the target information is located outside a central area of ​​the user interface displayed on the display unit.

[0062] For the embodiments of the device, since they basically correspond to the method embodiments, the relevant parts refer to the partial description of the method embodiments. The device embodiments described above are merely illustrative, wherein the modules described as separation modules may or may not be separated. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of the present embodiment. Those of ordinary skill in the art can understand and implement without paying creative work.

[0063] The method and device of the present disclosure are described above based on the embodiments and application examples. In addition, the present disclosure also provides an electronic device and a computer-readable storage medium, which are described below.

[0064] Reference below Figure 7, which shows a schematic diagram of the structure of an electronic device (such as a terminal device or a server) 800 suitable for implementing the embodiment of the present disclosure. The terminal device in the embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. The electronic device shown in the figure is only an example and should not bring any limitation to the functions and scope of use of the embodiment of the present disclosure.

[0065] The electronic device 800 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 801, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 802 or a program loaded from a storage device 808 into a random access memory (RAM) 803. In the RAM 803, various programs and data required for the operation of the electronic device 800 are also stored. The processing device 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0066] Typically, the following devices may be connected to the I / O interface 805: input devices 806 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 807 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 808 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 809. The communication device 809 may allow the electronic device 800 to communicate with other devices wirelessly or by wire to exchange data. Although the electronic device 800 with various devices is shown in the figure, it should be understood that it is not required to implement or have all the devices shown. More or fewer devices may be implemented or have alternatively.

[0067] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 809, or installed from a storage device 808, or installed from a ROM 802. When the computer program is executed by the processing device 801, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0068] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0069] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0070] The computer-readable medium may be included in the electronic device, or may exist independently without being installed in the electronic device.

[0071] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method of the present disclosure.

[0072] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0073] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0074] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the name of a unit does not, in some cases, limit the unit itself.

[0075] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0076] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0077] According to one or more embodiments of the present disclosure, a display control method is provided, wherein a display unit and a processing unit are communicatively connected, and a user can view a real environment through the display unit. The method includes:

[0078] The display unit displays a user interface, wherein the user interface includes: an image of a real environment presented by the display unit and target information generated by the processing unit;

[0079] In response to the user's head rotating in a first rotation direction, the target information is controlled to rotate in the user interface in a direction opposite to the first rotation direction of the head.

[0080] According to one or more embodiments of the present disclosure, a display control method is provided. During rotation of the head along a first rotation direction, if the target information is rotated to a preset boundary in the user interface in the opposite direction of the head along the first rotation direction, the position of the target information in the user interface is controlled to remain unchanged.

[0081] According to one or more embodiments of the present disclosure, a display control method is provided, wherein the target information moves with the movement of the user's head;

[0082] Before and after the movement of the head, the relative position of the target information and the head remains unchanged.

[0083] According to one or more embodiments of the present disclosure, a display control method is provided, wherein the target information is always located in a user interface currently displayed to the user, and the preset boundary is a boundary of a preset range in the user interface.

[0084] According to one or more embodiments of the present disclosure, a display control method is provided, which, before responding to the user's head rotating along a first rotation direction, further includes:

[0085] In response to the calibration operation, calibrating a default angle based on the current spatial angle information of the display unit;

[0086] The default angle is used to determine whether the user's head is rotated.

[0087] According to one or more embodiments of the present disclosure, a display control method is provided, wherein a default angle is calibrated, including:

[0088] calibrating a default pitch angle of the user's head; and / or,

[0089] The default horizontal angle of the user's head is calibrated.

[0090] According to one or more embodiments of the present disclosure, a display control method is provided, the method further comprising:

[0091] After the head and the target information are rotated, the position of the target information is controlled so that the relative position of the target information and the head remains unchanged before and after the head rotates along the first rotation direction.

[0092] According to one or more embodiments of the present disclosure, a display control method is provided, in response to the target information being located outside a central area of ​​a user interface displayed on the display unit before the user's head rotates in a first rotation direction.

[0093] According to one or more embodiments of the present disclosure, there is provided a display control device, including:

[0094] A processing unit, used for generating target information, a display unit and the processing unit are in communication connection, and a user can view the real environment through the display unit;

[0095] A display unit, used to display a user interface, wherein the user interface includes: an image of a real environment presented by the display unit and target information generated by the processing unit;

[0096] The control unit is used for controlling the target information to rotate in the user interface in a direction opposite to the first rotation direction of the head in response to the head of the user rotating in the first rotation direction.

[0097] According to one or more embodiments of the present disclosure, there is provided an electronic device, including: at least one memory and at least one processor;

[0098] The at least one memory is used to store program codes, and the at least one processor is used to call the program codes stored in the at least one memory to execute any one of the above methods.

[0099] According to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium is used to store program code, and when the program code is executed by a processor, the processor is prompted to execute the above method.

[0100] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0101] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0102] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. A display control method, characterized in that: The display unit is communicatively connected to the processing unit, and the user can view the real environment through the display unit. The method includes: The display unit displays a user interface, wherein the user interface includes: an image of a real environment presented by the display unit and target information generated by the processing unit; In response to the user's head rotating in a first rotation direction, the target information is controlled to rotate in the user interface in a direction opposite to the first rotation direction of the head.

2. The method according to claim 1, characterized in that: During the rotation of the head along the first rotation direction, if the target information rotates to a preset boundary in the user interface relative to the direction opposite to the first rotation direction of the head, the position of the target information in the user interface is controlled to remain unchanged.

3. The method according to claim 1, characterized in that The target information moves as the user's head moves; Before and after the movement of the head, the relative position of the target information and the head remains unchanged.

4. The method according to claim 2, characterized in that The target information is always located in the user interface currently displayed to the user, and the preset boundary is the boundary of a preset range in the user interface.

5. The method according to claim 1, characterized in that Before responding to the user's head rotating along the first rotation direction, the method further includes: In response to the calibration operation, calibrating a default angle based on the current spatial angle information of the display unit; The default angle is used to determine whether the user's head is rotated.

6. The method according to claim 5, characterized in that Calibrate the default angles, including: calibrating a default pitch angle of the user's head; and / or, The default horizontal angle of the user's head is calibrated.

7. The method according to claim 1, characterized in that The method further comprises: After the head and the target information are rotated, the position of the target information is controlled so that the relative position of the target information and the head remains unchanged before and after the head rotates along the first rotation direction.

8. The method according to claim 1, characterized in that: In response to the user's head rotating in a first rotation direction, the target information is located outside a central area of ​​the user interface displayed on the display unit.

9. A display control device, characterized in that: include: A processing unit, used for generating target information, a display unit and the processing unit are in communication connection, and a user can view the real environment through the display unit; A display unit, configured to display a user interface, wherein the user interface includes: an image of a real environment presented by the display unit and target information generated by the processing unit; The control unit is used for controlling the target information to rotate in the user interface in a direction opposite to the first rotation direction of the head in response to the head of the user rotating in the first rotation direction.

10. An electronic device, comprising: at least one memory and at least one processor; The at least one memory is used to store program code, and the at least one processor is used to call the program code stored in the at least one memory to execute the method according to any one of claims 1 to 8.

11. A computer-readable storage medium, the computer-readable storage medium being used to store program code, wherein when the program code is executed by a processor, the processor is prompted to execute the method according to any one of claims 1 to 8.

Images