Interaction methods, devices, near-eye display devices, and readable storage media

Abstract

This disclosure provides an interaction method, apparatus, near-eye display device, and readable storage medium. The interaction method includes: obtaining the usage state of a first device; generating and displaying a virtual identifier in a first interaction mode when the usage state of the first device is a first state; and generating and displaying a virtual identifier in a second interaction mode when the usage state of the first device is a second state; wherein the virtual identifier is different in the first interaction mode and the second interaction mode.

Description

Technical Field

[0001] This disclosure relates to the field of near-eye display technology, and more specifically, to an interactive method, apparatus, near-eye display device, and readable storage medium. Background Technology

[0002] Currently, near-eye display devices are becoming increasingly intelligent and are becoming the mainstream in the market. Current technology uses the mobile phone's IMU as a controller for the near-eye display device. When the phone is rotated, the control modules (mouse, ray, etc.) in the near-eye display device also move, enabling interaction with related applications and achieving the function of a 3DOF controller. Existing technology defaults to the user placing the phone horizontally, in which case the ray displayed on the near-eye display device points forward. However, some users are accustomed to rotating the phone vertically to control it, resulting in the ray still pointing upwards in the near-eye display device, making it unusable. Summary of the Invention

[0003] The purpose of this disclosure is to provide an interaction method, apparatus, device, and storage medium.

[0004] According to a first aspect of this disclosure, an interaction method is provided, the interaction method comprising: obtaining the usage state of a first device; generating and displaying a virtual identifier in a first interaction mode when the usage state of the first device is a first state; and generating and displaying a virtual identifier in a second interaction mode when the usage state of the first device is a second state; wherein the virtual identifier is different in the first interaction mode and the second interaction mode.

[0005] Optionally, in the first interaction mode, the virtual identifier is a straight line; in the second interaction mode, the virtual identifier is a curve.

[0006] Optionally, generating a virtual identifier in a first interaction mode includes: generating a virtual identifier from a preset starting point along the orientation of the first device.

[0007] Optionally, generating a virtual identifier in a second interaction mode includes: generating a virtual identifier facing the virtual screen from a preset starting point, with the orientation of the first device as the initial direction.

[0008] Optionally, obtaining the usage state of the first device includes: obtaining sensor data of the first device, the sensor data including a first component along a first direction and a second component along a second direction, wherein the first direction is a direction perpendicular to the display body of the first device, and the second direction is a direction along the height of the display body of the first device; if the first component is greater than the second component, the usage state of the first device is determined to be a first state; if the first component is less than the second component, the usage state of the first device is determined to be a second state.

[0009] Optionally, the interaction method further includes: obtaining the target interaction mode corresponding to the target application, wherein the target interaction mode is a first interaction mode or a second interaction mode; and generating and displaying a virtual identifier in the target interaction mode when the target application is running.

[0010] According to a second aspect of this disclosure, an interactive device is provided, comprising: a first acquisition module for acquiring the usage state of a first device; a first generation module for generating and displaying a virtual identifier in a first interaction mode when the usage state of the first device is a first state; and a second generation module for generating and displaying a virtual identifier in a second interaction mode when the usage state of the first device is a second state; wherein the virtual identifier is different in the first interaction mode and the second interaction mode.

[0011] Optionally, the first acquisition module includes: an acquisition unit, configured to acquire sensor data of the first device, the sensor data including a first component along a first direction and a second component along a second direction, wherein the first direction is a direction perpendicular to the display body of the first device, and the second direction is a direction along the height of the display body of the first device; a first determination unit, configured to determine the usage state of the first device as a first state when the first component is greater than the second component; and a second determination unit, configured to determine the usage state of the first device as a second state when the first component is less than the second component.

[0012] According to a third aspect of this disclosure, a near-eye display device is provided, the near-eye display device including a communication module, the near-eye display device further including: a memory for storing executable computer instructions; a processor for executing an interaction method according to any one of the first aspects under the control of the executable computer instructions; wherein the communication module is used to establish a communication connection with a terminal device.

[0013] According to a fourth aspect of this disclosure, a computer-readable storage medium is provided, characterized in that computer instructions are stored on the computer-readable storage medium, and the computer instructions are executed by a processor to perform an interaction method as described in any of the first aspects.

[0014] According to an embodiment of this application, the usage status of a first device is obtained; when the usage status of the first device is a first state, a virtual identifier is generated and displayed in a first interaction mode; when the usage status of the first device is a second state, a virtual identifier is generated and displayed in a second interaction mode; wherein the virtual identifier is different in the first interaction mode and the second interaction mode. In this way, a corresponding virtual identifier can be automatically generated according to the user's different usage status of the first device, using a matching interaction mode, thereby improving the convenience of user operation and enhancing the user experience.

[0015] Other features and advantages of the invention will become clear from the following detailed description of exemplary embodiments of the invention with reference to the accompanying drawings. Attached Figure Description

[0016] To more clearly illustrate the technical solutions of the embodiments of this disclosure, the accompanying drawings used in the embodiments will be briefly described below. It should be understood that the following drawings only show some embodiments of the present invention and should not be considered as limiting the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0017] Figure 1 This is a hardware configuration diagram of a display system that can be used to implement an interactive method of one embodiment;

[0018] Figure 2 This is a flowchart illustrating an interaction method according to one embodiment;

[0019] Figure 3 This is a schematic diagram of an interaction method according to another embodiment;

[0020] Figure 4 This is a schematic diagram of an interaction method according to another embodiment;

[0021] Figure 5 This is a schematic diagram of an interaction method according to another embodiment;

[0022] Figure 6 This is a schematic diagram of an interaction method according to another embodiment;

[0023] Figure 7 This is a schematic block diagram of an interactive device according to one embodiment;

[0024] Figure 8 This is a schematic diagram of the hardware structure of a near-eye display device according to one embodiment. Detailed Implementation

[0025] Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of the components and steps set forth in these embodiments do not limit the scope of the invention.

[0026] The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit the invention or its application or use.

[0027] Techniques, methods, and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, they should be considered part of the specification.

[0028] In all the examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limitations. Therefore, other examples of exemplary embodiments may have different values.

[0029] It should be noted that similar labels and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.

[0030] Hereinafter, various embodiments and examples according to the present disclosure will be described with reference to the accompanying drawings.

[0031] <Hardware Configuration>

[0032] Figure 1 This is a hardware configuration diagram of a display system that can be used to implement an interactive method of one embodiment. Figure 1 A near-eye display device 100, a first device 200, and a network 300 are illustrated. The near-eye display device 100 can connect to the network 300 and can also connect to the first device 200 via a communication method such as Bluetooth. In one embodiment, the near-eye display device 100 connects to the first device 200 only via a communication method such as Bluetooth. Multiple servers 301 and 302 can be configured in the network 300. The network 300 can be a wireless communication network or a wired communication network. The network 300 can be a local area network (LAN) or a wide area network (WAN). The network 300 can be for short-range communication or long-range communication.

[0033] In one embodiment, Figure 1 As shown, the near-eye display device 100 may include a processor 101 and a memory 102. The near-eye display device 100 also includes a communication device 103, a display device 104, a user interface 105, a camera device 106, an audio / video interface 107, and a sensor 108, etc. Furthermore, the near-eye display device 100 may also include a power management chip 109 and a battery 110, etc.

[0034] The processor 101 can be any type of processor. The memory 102 can store the underlying software, system software, application software, data, etc., required for the operation of the near-eye display device 100. The memory 102 can include various forms of memory, such as ROM, RAM, Flash, etc. The communication device 103 can include, for example, a WiFi communication device, a Bluetooth communication device, a 3G, 4G, or 5G communication device. Through the communication device 103, the near-eye display device 100 can be deployed in a network. The display device 104 can be a liquid crystal display, an OLED display, etc. In one example, the display device 104 can be a touchscreen. Users can perform input operations through the display device 104. Furthermore, users can also perform fingerprint recognition, etc., through the touchscreen. The user interface 105 can include a USB interface, a Lightning interface, a keyboard, etc. The camera device 106 can be a single camera or multiple cameras. The audio / video interface 107 can include, for example, a speaker interface, a microphone interface, a video transmission interface such as HDMI, etc. The sensor 108 can include, for example, a gyroscope, an accelerometer, a temperature sensor, a humidity sensor, a pressure sensor, etc. For example, the sensor can determine the posture information of the near-eye display device. The power management chip 109 can be used to manage the power input to the near-eye display device 100, and can also manage the battery 110 to ensure maximum utilization efficiency. The battery 110 is, for example, a lithium-ion battery.

[0035] The near-eye display device 100 can be VR (Virtual Reality) glasses, AR (Augmented Reality) glasses, or MR (Mixed Reality) glasses, etc., and this disclosure does not limit it. Figure 1 The components shown are merely illustrative. The near-eye display device 100 may include... Figure 1 One or more of the components shown, but not necessarily including Figure 1 All components in it. Figure 1 The near-eye display device 100 shown is merely illustrative and is by no means intended to limit the embodiments, applications, or uses herein.

[0036] In this embodiment, the memory 102 of the near-eye display device 100 is used to store program instructions that control the processor 101 to perform interactive methods. Those skilled in the art can design these instructions based on the disclosed scheme of this invention. How the instructions control the processor to perform operations is well known in the art and will not be described in detail here.

[0037] In one embodiment, Figure 1As shown, the first device 200 may include a processor 201 and a memory 202. The first device 200 also includes a communication device 203, a display device 204, a user interface 205, a camera device 206, an audio / video interface 207, and a sensor 208, etc. Furthermore, the first device 200 may also include a power management chip 209 and a battery 210, etc.

[0038] The first device 200 may be a mobile phone, a portable computer, a tablet computer, a handheld computer, a wearable device, etc., and this disclosure does not limit it. Figure 1 The components shown are merely illustrative. The first device 200 may include... Figure 1 One or more of the components shown, but not necessarily including Figure 1 All components in it. Figure 1 The first device 200 shown is merely illustrative and is by no means intended to limit the embodiments, applications, or uses herein.

[0039] In this embodiment, the memory 202 of the first device 200 is used to store program instructions that control the processor 201 to perform interactive methods. Those skilled in the art can design these instructions based on the disclosed scheme of this invention. How the instructions control the processor to perform operations is well known in the art and will not be described in detail here.

[0040] It should be understood that, despite Figure 1 Only one near-eye display device 100 and one first device 200 are shown, but this does not mean that the number of each is limited. The display system may contain multiple near-eye display devices 100 and multiple first devices 200.

[0041] In the above description, those skilled in the art can design instructions based on the solutions provided in this disclosure. How the instructions control the processor to operate is well known in the art, and therefore will not be described in detail here.

[0042] <Method Implementation>

[0043] This disclosure provides an interaction method, which can be provided by... Figure 1 The implementation of the display system shown is as follows: Figure 2 As shown, the interaction method includes the following steps: steps S2100 to S2300.

[0044] Step S2100: Obtain the usage status of the first device.

[0045] In the embodiments of this application, the first device can be a mobile phone, a portable computer, a tablet computer, a PDA, a wearable device, etc., without limitation. The near-eye display device can be a head-mounted smart device used in conjunction with the first device. The near-eye display device can be virtual reality glasses, augmented reality glasses, mixed reality glasses, etc., without limitation. The first device can have a built-in IMU (inertial motion unit), which is a combination of accelerometer and gyroscope sensors. Therefore, the user can control the display interface in the near-eye display device by using the first device as a handle.

[0046] The user's usage status of the first device can be determined by the IMU (inertial motion unit) built into it. When the user activates the first device as a gamepad, their usage status can be categorized into two types. For example... Figure 3 As shown, the first device can be in a horizontal orientation for use. Figure 4 As shown, the first device can also be used in a vertical orientation. Depending on how the user uses the first device, the horizontal orientation can be defined as the first state, and the vertical orientation as the second state.

[0047] In the embodiments of this disclosure, step S2100, which involves obtaining the usage status of the first device, further includes steps S2110 to S2130, as follows:

[0048] Step S2110: Obtain sensor data from the first device. The sensor data includes a first component along a first direction and a second component along a second direction, wherein the first direction is perpendicular to the display body of the first device, and the second direction is along the height direction of the display body of the first device.

[0049] An inertial motion unit (IMU) is a device that responds to physical motion, such as linear displacement or angular rotation, and converts this response into electrical signals, which are then amplified and processed by electronic circuits. Accelerometers and gyroscopes are the two most common types of MEMS inertial sensors. An accelerometer is a sensor that senses axial acceleration and converts it into a usable output signal; a gyroscope is a sensor that senses the angular velocity of a moving body relative to inertial space. Combining three MEMS accelerometers and three MEMS gyroscopes forms a miniature inertial measurement unit capable of sensing linear acceleration and acceleration in three directions of a carrier.

[0050] In embodiments of this application, the sensor data detected by the IMU (inertial motion unit) in the first device may include a first component in a first direction and a second component in a second direction. The first direction is always perpendicular to the display screen of the first device, and the second direction is always consistent with the long side extension direction of the display screen of the first device.

[0051] Step S2120: If the first component is greater than the second component, determine the usage state of the first device as the first state.

[0052] If the first component of the sensor data in the first direction is greater than the second component in the second direction, it indicates that the first device is in a horizontal orientation state. Based on this, the user's usage state of the first device can be determined as the first state.

[0053] Step S2130: If the first component is less than the second component, determine the usage state of the first device as the second state.

[0054] If the first component of the sensor data in the first direction is less than the second component in the second direction, it indicates that the first device is in a vertical orientation state. Based on this, the user's usage state of the first device can be determined to be the second state.

[0055] In one embodiment of this disclosure, the virtual identifier is a straight line in a first interaction mode and a curve in a second interaction mode.

[0056] Step S2200: When the first device is in the first state of use, a virtual identifier is generated and displayed in the first interaction mode.

[0057] When the first device is in the first state of use, a virtual identifier is generated using the first interaction mode. That is, if the first device is determined to be in the first state of use based on the sensor data of the IMU (inertial motion unit) in the first device, then one end of the near-eye display device can use the first interaction mode.

[0058] When a user wears a near-eye display device, a virtual image is displayed in front of their eyes. If the user needs to select or control a target object within this virtual image, they can control the device to generate a corresponding virtual marker on the near-eye display. This marker intersects with the target content in the virtual image, allowing the user to select or control the target content. Depending on how the user uses the device, the virtual marker can be a solid line, dashed line, arrow, etc. The virtual solid line can be a straight line or a curve. Figure 6 As shown, the intersection position 61 can be the location where the virtual icon and the virtual screen intersect.

[0059] like Figure 5 As shown, when the first device is in its first state of use, the near-eye display device generates and displays virtual icons using a first interaction mode. The first interaction mode uses a ray system for interaction. In this ray system, the virtual icon can be displayed as the trajectory of a virtual straight line. The user's interaction with the near-eye display device can be determined by judging whether the virtual icon intersects with the target content in the virtual image.

[0060] Exemplarily, a virtual screen displays multiple applications, and a user wants to select one of these applications by operating a first device. With the first device in a first usage state, the user controls the first device to point a virtual identifier on the near-eye display device to the icon of the desired application. When the virtual identifier intersects with the application's icon, and this intersection remains for a preset time, the target application that the user wants to open is confirmed. Based on this, the near-eye display device can open the target application. Thus, user interaction with the near-eye display device can be determined by judging whether the virtual identifier intersects with the target content in the virtual screen.

[0061] In the embodiments of this application, step S2200, when the usage state of the first device is in the first state, generates and displays a virtual identifier in the first interaction mode, including step S2210, as follows:

[0062] Step S2210: Generate a virtual identifier from a preset starting point along the orientation of the first device.

[0063] In the embodiments of this application, the first interaction mode can use a ray system for interaction. In the ray system, the virtual marker displayed within the near-eye display device can be a virtual straight line. During the generation of the virtual marker by the ray system, a virtual straight line can be generated from a preset starting point along the orientation of the first device. During the user's operation of the first device, the direction of the virtual marker can always remain consistent with the orientation of the long side of the first device. In addition, the preset starting point for generating the virtual straight line can be the midpoint of the line connecting the user's two pupils, or it can be other positions, which can be set according to the actual situation and are not limited here.

[0064] In step S2300, when the usage state of the first device is the second state, a virtual identifier is generated and displayed in the second interaction mode.

[0065] When the first device is in the second state of use, the virtual identifier is generated using the second interaction mode. That is, if the sensor data of the IMU (inertial motion unit) in the first device determines that the first device is in the second state of use, then one end of the near-eye display device can use the second interaction mode.

[0066] like Figure 5 As shown, when the first device is in the second state, the near-eye display device generates and displays virtual icons using the second interaction mode. The second interaction mode uses a particle system for interaction. In this example system, the virtual icons can be displayed as curved trajectories. The user's interaction with the near-eye display device can also be determined by judging whether the virtual icons intersect with the target content in the virtual image.

[0067] It's important to note that when the first device is in its second state, the second interaction mode is used to generate the virtual identifier. That is, if the message from the first device indicates the phone is facing vertically, the near-eye display device can use a particle system for interaction, and the virtual identifier can be displayed as a curve. It's important to note that this curve can be composed of multiple continuously emitted virtual particles. Based on this, the specific generation method of the virtual identifier is as follows: based on the preset starting point mentioned above, dense virtual particles are emitted at the preset starting point. When the first device is in its second state, its initial orientation is vertical. Since the virtual particles have an initial velocity in the initial direction of the first device, i.e., the vertical direction, and gravitational acceleration in the Y-axis direction, if the emission point is taken as the origin, the formula for calculating the correspondence between the z-axis and y-axis directions of the particles in space is:

[0068]

[0069] In the formula, t is the particle's travel time, v0 is the initial velocity of the emission, θ is the angle between the phone's direction and the Z-axis, and g is the gravitational acceleration.

[0070] Exemplarily, a virtual screen displays multiple applications, and a user wants to select one of these applications by operating a first device. When the first device is in a second usage state, the user controls the first device to point a virtual identifier on the near-eye display device to the icon of the desired application. When the virtual identifier intersects with the application's icon, and this intersection remains for more than a preset time, the target application that the user wants to open is confirmed. Based on this, the near-eye display device can open the target application. Thus, user interaction with the near-eye display device can be determined by judging whether the virtual identifier intersects with the target content in the virtual screen.

[0071] In the embodiments of this application, step S2300, when the usage state of the first device is the second state, generates and displays a virtual identifier in the second interaction mode, including step S2310, as follows:

[0072] Step S2310: Using the orientation of the first device as the initial direction, generate a virtual identifier for the virtual screen to be displayed from a preset starting point. The virtual identifier differs in the first interaction mode and the second interaction mode.

[0073] In the embodiments of this application, the second interaction mode can use a particle system for interaction. In the ray system, the virtual identifier displayed in the near-eye display device can be a curve. During the process of generating the virtual identifier by the particle system, the virtual particle can generate the virtual identifier from a preset starting point according to the generation method described above. In addition, the preset starting point for generating the virtual identifier in the second interaction mode can specifically be the midpoint of the line connecting the two pupils of the user's eye, or it can be set to other positions. This can be set according to the actual situation and is not limited here.

[0074] In another embodiment of this application, the user can also pre-set interaction modes for multiple applications in the settings interface of the first device, so that the applications can generate virtual identifiers according to the preset interaction modes, which may include steps S3100 to S3200:

[0075] Step S3100: Obtain the target interaction mode corresponding to the target application, wherein the target interaction mode is either the first interaction mode or the second interaction mode.

[0076] In embodiments of this application, multiple applications can be installed on the first device. The user selects and opens one of the multiple applications, designating it as the target application. The interaction mode of the target application can be set in the settings interface of the first device; it can be set to either a first interaction mode or a second interaction mode.

[0077] Step S3200: With the target application running, generate and display the virtual identifier in the target interaction mode.

[0078] When a user opens the target application, the target application can determine its interaction method according to the interaction mode pre-selected in the settings interface of the first device, in order to generate and display the corresponding virtual icon. For example, if the target application selects the first interaction mode in the settings interface of the first device, then after the target application is opened, the corresponding virtual icon will be generated and displayed in the near-eye display device using the first interaction mode.

[0079] According to an embodiment of this application, the usage status of a first device is obtained; when the usage status of the first device is a first state, a virtual identifier is generated and displayed in a first interaction mode; when the usage status of the first device is a second state, a virtual identifier is generated and displayed in a second interaction mode; wherein the virtual identifier is different in the first interaction mode and the second interaction mode. In this way, a corresponding virtual identifier can be automatically generated according to the user's different usage status of the first device, using a matching interaction mode, thereby improving the convenience of user operation and enhancing the user experience.

[0080] <Device Embodiment>

[0081] This disclosure provides an interactive device, such as... Figure 7 As shown, the interactive device 600 may include a first acquisition module 601, a first generation module 602, and a second generation module 603.

[0082] The first acquisition module 601 is used to acquire the usage status of the first device;

[0083] The first generation module 602 is used to generate and display a virtual identifier in a first interaction mode when the usage state of the first device is a first state.

[0084] The second generation module 603 is used to generate and display a virtual identifier in a second interaction mode when the usage state of the first device is the second state.

[0085] In one embodiment of this application, the first acquisition module 601 includes:

[0086] The acquisition unit is used to acquire sensor data of the first device. The sensor data includes a first component along a first direction and a second component along a second direction, wherein the first direction is a direction perpendicular to the display body of the first device, and the second direction is a direction along the height of the display body of the first device.

[0087] The first determining unit is configured to determine the usage state of the first device as the first state when the first component is greater than the second component.

[0088] The second determining unit is used to determine the usage state of the first device as the second state when the first component is less than the second component.

[0089] In one embodiment of this application, the first generation module 602 is specifically used to generate a virtual identifier from a preset starting point along the orientation of the first device.

[0090] In one embodiment of this application, the second generation module 603 is specifically used to generate the virtual identifier of the virtual screen to be displayed facing the first device from a preset starting point, with the orientation of the first device as the initial direction.

[0091] In one embodiment of this application, the interactive device 600 may further include: a second acquisition module, configured to acquire a target interaction mode corresponding to a target application, wherein the target interaction mode is either the first interaction mode or the second interaction mode; and a third generation module, configured to generate and display a virtual identifier in the target interaction mode when the target application is running.

[0092] According to an embodiment of this application, the usage status of a first device is obtained; when the usage status of the first device is a first state, a virtual identifier is generated and displayed in a first interaction mode; when the usage status of the first device is a second state, a virtual identifier is generated and displayed in a second interaction mode; wherein the virtual identifier is different in the first interaction mode and the second interaction mode. In this way, a corresponding virtual identifier can be automatically generated according to the user's different usage status of the first device, using a matching interaction mode, thereby improving the convenience of user operation and enhancing the user experience.

[0093] <Equipment Example>

[0094] This disclosure also provides a near-eye display device 700, such as... Figure 8 As shown, the near-eye display device 700 includes a communication module 701, and the near-eye display device 700 further includes: a memory 702 for storing executable computer instructions; and a processor 703 for executing the steps of the interactive method provided in the embodiments of this disclosure according to the control of the executable computer instructions; wherein, the communication module is used to establish a communication connection with a terminal device.

[0095] Computer-readable storage media

[0096] This disclosure also provides a computer-readable storage medium storing computer instructions thereon, which, when executed by a processor, perform the interactive method provided in this disclosure.

[0097] Embodiments of this disclosure may be systems, methods, and / or computer program products. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of the embodiments of this disclosure.

[0098] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination thereof. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0099] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0100] Computer program instructions used to perform the operations of embodiments of this disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuitry, such as programmable logic circuitry, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), is personalized by utilizing state information from the computer-readable program instructions. This electronic circuitry can execute the computer-readable program instructions to implement various aspects of embodiments of this disclosure.

[0101] Various aspects of embodiments of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0102] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0103] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0104] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions. It is well known to those skilled in the art that implementation in hardware, implementation in software, and implementation using a combination of software and hardware are equivalent.

[0105] The various embodiments of this disclosure have been described above. These descriptions are exemplary and not exhaustive, and are not limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or technical improvements to the embodiments in the market, or to enable others skilled in the art to understand the embodiments disclosed herein. The scope of the embodiments of this disclosure is defined by the appended claims.

Claims

1. An interaction method, characterized in that, The method includes: Obtain the usage status of the first device; When the first device is in the first state of use, a virtual identifier is generated and displayed in the first interaction mode; When the first device is in the second usage state, a virtual identifier is generated and displayed in the second interaction mode; In the first interaction mode and the second interaction mode, the virtual identifier is different; The step of obtaining the usage status of the first device includes: Acquire sensor data from the first device, the sensor data including a first component along a first direction and a second component along a second direction, wherein the first direction is a direction perpendicular to the display body of the first device, and the second direction is a direction along the height of the display body of the first device; If the first component is greater than the second component, the usage state of the first device is determined to be the first state; If the first component is less than the second component, the usage state of the first device is determined to be the second state.

2. The method according to claim 1, characterized in that, In the first interaction mode, the virtual identifier is a straight line; In the second interaction mode, the virtual identifier is a curve.

3. The method according to claim 1, characterized in that, The generation of the virtual identifier in the first interaction mode includes: A virtual identifier is generated from a preset starting point along the orientation of the first device.

4. The method according to claim 1, characterized in that, The generation of the virtual identifier using the second interaction mode includes: The virtual identifier of the virtual image to be displayed is generated from a preset starting point, with the orientation of the first device as the initial direction.

5. The method according to claim 1, characterized in that, The method further includes: Obtain the target interaction mode corresponding to the target application, wherein the target interaction mode is either the first interaction mode or the second interaction mode; When the target application is running, a virtual identifier is generated and displayed in the target interaction mode.

6. An interactive device, characterized in that, include: The first acquisition module is used to acquire the usage status of the first device; The first generation module is used to generate and display a virtual identifier in a first interaction mode when the usage state of the first device is a first state. The second generation module is used to generate and display a virtual identifier in a second interaction mode when the usage state of the first device is the second state. In the first interaction mode and the second interaction mode, the virtual identifier is different; The first acquisition module includes: An acquisition unit is configured to acquire sensor data of the first device, the sensor data including a first component along a first direction and a second component along a second direction, wherein the first direction is a direction perpendicular to the display body of the first device, and the second direction is a direction along the height of the display body of the first device. The first determining unit is configured to determine the usage state of the first device as a first state when the first component is greater than the second component. The second determining unit is used to determine the usage state of the first device as the second state when the first component is less than the second component.

7. A near-eye display device, characterized in that, Including a communication module, the near-eye display device further includes: Memory is used to store executable computer instructions; A processor configured to execute the interaction method according to any one of claims 1-5, under the control of the executable computer instructions. The communication module is used to establish a communication connection with the terminal device.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that, when executed by a processor, perform the interactive method according to any one of claims 1-5.

Images