Equipment interaction method and device, medium and electronic equipment

Abstract

The embodiment of the invention provides an equipment interaction method and device, a medium and electronic equipment. The method comprises the following steps: receiving a control instruction sent by the operation equipment, wherein the control instruction is generated by the operation equipment according to a detected predetermined operation; and controlling the head-mounted device according to the current operation mode of the head-mounted device and the control instruction. According to the technical scheme provided by the embodiment of the invention, the same control instruction of the operation equipment can be applicable to different operation modes of the wearable equipment, namely, the same control instruction is applicable to different use scenes of the head-mounted equipment, so that the operability of the head-mounted equipment and the convenience of interaction between the operation equipment and the head-mounted equipment are improved.

Description

Technical Field

[0001] The present application relates to the technical field of head-mounted devices, and in particular to a device interaction method, apparatus, medium and electronic device. Background Art

[0002] A head-mounted device (HMD) refers to an electronic device that is worn on the user's head and has an independent CPU, storage unit, communication module, and near-eye display. During use, the head-mounted device needs to be worn on the user's head. Since the head-mounted device is worn on the user's head, it is not convenient for the user to operate, and the size of the head-mounted device cannot be too large, otherwise it will be too heavy and uncomfortable to wear. Therefore, the operating area on the head-mounted device that can be used to set and control the head-mounted device is also limited. However, with the diversification of the use scenarios of head-mounted devices, how to adapt to a variety of use scenarios and improve the operability of head-mounted devices has become a technical problem that needs to be solved urgently. Summary of the invention

[0003] The embodiments of the present application provide a device interaction method, apparatus, medium and electronic device, which enable the head-mounted device to adapt to a variety of usage scenarios, at least to a certain extent, and improve the operability of the head-mounted device.

[0004] Other features and advantages of the present application will become apparent from the following detailed description, or may be learned in part by the practice of the present application.

[0005] According to one aspect of an embodiment of the present application, a device interaction method is provided, which is applied to a head-mounted device, wherein the head-mounted device is communicatively connected to at least one operating device;

[0006] The method comprises:

[0007] receiving a control instruction sent by the operating device, wherein the control instruction is generated by the operating device according to a detected predetermined operation;

[0008] The head mounted device is controlled according to a current operation mode of the head mounted device and the control instruction.

[0009] In some embodiments of the present application, the method further comprises:

[0010] Displaying a control cursor adapted to the operation mode on a display interface of the head mounted device;

[0011] Controlling the head mounted device according to the current operation mode of the head mounted device and the control instruction comprises:

[0012] According to the current operation mode of the head mounted device and the control instruction, the control cursor is controlled to perform actions to realize control of the head mounted device.

[0013] In some embodiments of the present application, the method further comprises:

[0014] If no new control instruction is received within the first predetermined time, the control cursor is restored to a default position, and the control cursor is hidden after a second predetermined time.

[0015] In some embodiments of the present application, before receiving the control instruction sent by the operating device, the method further includes:

[0016] According to the received mode selection instruction sent by the operating device, entering the operating mode corresponding to the mode selection instruction;

[0017] or

[0018] According to the number of operating devices communicatively connected to the head mounted device, entering an operating mode corresponding to the number of the operating devices;

[0019] or

[0020] According to the application currently started by the head mounted device, an operation mode corresponding to the application is entered.

[0021] In some embodiments of the present application, the method further comprises:

[0022] In response to a function editing request for a function button on the operating device, displaying a button function editing interface in a display interface, wherein the button function editing interface includes function information corresponding to each of the function buttons;

[0023] Determine the function key to be edited according to the received selection information for the function key;

[0024] Based on the received function editing information for the function key to be edited, the function information corresponding to the function key to be edited is updated, wherein the function editing information includes a control instruction for controlling the action of the control cursor.

[0025] In some embodiments of the present application, controlling the head mounted device according to the current operation mode of the head mounted device and the control instruction includes:

[0026] When the control instruction is generated based on the sliding operation, controlling the head mounted device to perform an operation of a first function corresponding to the sliding operation in the operation mode;

[0027] When the control instruction is generated based on a click operation, controlling the head mounted device to perform an operation of a second function corresponding to the click operation in the operation mode, wherein the click operation includes a single click operation and a double click operation;

[0028] When the control instruction is generated based on a long press operation, controlling the head mounted device to perform an operation of a third function corresponding to the long press operation in the operation mode;

[0029] When the control instruction is generated based on the scrolling operation, the head mounted device is controlled to perform an operation of a fourth function corresponding to the scrolling operation in the operation mode.

[0030] According to one aspect of an embodiment of the present application, there is provided a device interaction method, which is applied to an operating device, wherein the operating device is communicatively connected to a head mounted device;

[0031] The method comprises:

[0032] generating a control instruction according to the detected predetermined operation;

[0033] The control instruction is sent to the head mounted device, so that the head mounted device controls the head mounted device according to a current operation mode and the control instruction.

[0034] According to one aspect of an embodiment of the present application, there is provided a device interaction apparatus, which is applied to a head-mounted device, wherein the head-mounted device is communicatively connected to at least one operating device;

[0035] The interactive device comprises:

[0036] A receiving module, configured to receive a control instruction sent by the operating device, wherein the control instruction is generated by the operating device according to a detected predetermined operation;

[0037] A processing module controls the head mounted device according to a current operation mode of the head mounted device and the control instruction.

[0038] According to one aspect of an embodiment of the present application, there is provided an interactive device for a device, which is applied to an operating device, wherein the operating device is communicatively connected to a head mounted device;

[0039] The interactive device comprises:

[0040] A generating module, used for generating a control instruction according to the detected predetermined operation;

[0041] The sending module is used to send the control instruction to the head mounted device, so that the head mounted device can realize corresponding control according to the current operation mode and the control instruction.

[0042] According to one aspect of an embodiment of the present application, a computer-readable medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the interaction method of the device described in the above embodiment is implemented.

[0043] According to one aspect of an embodiment of the present application, an electronic device is provided, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the interaction method of the device as described in the above embodiment.

[0044] In the technical solutions provided in some embodiments of the present application, the head-mounted device can receive a control instruction sent by the operating device through communication between the head-mounted device and the operating device, and the control instruction is generated by the operating device according to the detected predetermined operation, and then the head-mounted device is controlled according to the current operation mode and the control instruction. Thus, in different operation modes (i.e., usage scenarios), the head-mounted device can convert the same control instruction into corresponding operation steps and execute them, so that the same control instruction of the operating device is applicable to different operation modes of the wearable device, i.e., applicable to different usage scenarios of the head-mounted device, thereby improving the operability of the head-mounted device and the convenience of interaction between the operating device and the head-mounted device.

[0045] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] The drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present application, and together with the specification, are used to explain the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. In the drawings:

[0047] Figure 1 A schematic diagram showing a flow chart of a method for interacting with a device according to an embodiment of the present application is shown;

[0048] Figure 2 A block diagram showing an interaction device of a device according to an embodiment of the present application is shown;

[0049] Figure 3 A schematic diagram of the structure of a computer system suitable for implementing an electronic device of an embodiment of the present application is shown. DETAILED DESCRIPTION

[0050] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this application will be more comprehensive and complete and fully convey the concept of the example embodiments to those skilled in the art.

[0051] In addition, described feature, structure or characteristic can be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present application. However, those skilled in the art will appreciate that the technical scheme of the present application can be put into practice without one or more of the specific details, or other methods, components, devices, steps, etc. can be adopted. In other cases, known methods, devices, realizations or operations are not shown or described in detail to avoid blurring the various aspects of the application.

[0052] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities may be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0053] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps can be decomposed, and some operations / steps can be combined or partially combined, so the actual execution order may change according to actual conditions.

[0054] Figure 1 The flowchart of the device interaction method according to one embodiment of the present application is shown, and the method can be applied to a head-mounted device, such as smart glasses (AR glasses, VR glasses, etc.), headphones, etc. The head-mounted device is communicatively connected with at least one operating device, that is, the head-mounted device can be communicatively connected with one, two or more operating devices. The operating device can be a finger ring, an operating handle, etc.

[0055] It should be noted that the head mounted device and the operating device may be connected via a wired communication connection or a wireless communication connection, such as Bluetooth, WiFi, etc., and there is no special limitation on this.

[0056] Please refer to Figure 1 The interactive method of the device at least includes steps S110 to S120, which are described in detail as follows:

[0057] In step S110, a control instruction sent by the operating device is received, where the control instruction is generated by the operating device according to a detected predetermined operation.

[0058] In one embodiment, after the user has finished wearing the head-mounted device and the operating device, the two devices can be turned on. At this time, the operating device can search for a connectable head-mounted device and connect to it, thereby achieving communication between the operating device and the head-mounted device.

[0059] The operating device may be configured with at least one function button, which may be a physical button and / or a touch input device, and the present application does not specifically limit this. For example, the function button may include but is not limited to one or more of a scroll wheel, a home button, an auxiliary button, and a touch button.

[0060] The user can perform a predetermined operation on the function button so that the operating device generates a corresponding control instruction according to the corresponding predetermined operation. Taking the function button as a touch input device as an example, the user can slide the finger on the touch input device, and the operating device can detect the distance and direction of the user's finger sliding to generate a corresponding control instruction. The head-mounted device can receive the control instruction sent by the operating device for subsequent processing.

[0061] In step S120, the head mounted device is controlled according to the current operation mode of the head mounted device and the control instruction.

[0062] In this embodiment, after receiving the control instruction, the head-mounted device can determine its current operating mode to determine the operation corresponding to the control instruction. It should be understood that in different operating modes, even the same control instruction can correspond to the same or different control operations. As a result, the same control instruction of the operating device is applicable to different operating modes of the wearable device, that is, to different usage scenarios of the head-mounted device, thereby improving the operability of the head-mounted device and the convenience of interaction between the operating device and the head-mounted device.

[0063] In one example, the operation mode of the head mounted device may include but is not limited to at least one of a one-handed operation mode, a two-handed operation mode, a game operation mode, a music playback mode, a video playback mode, and a custom mode.

[0064] Among them, when there is only one operating device connected to the head-mounted device, the head-mounted device can enter the one-handed operation mode. Correspondingly, when there are two operating devices connected to the head-mounted device at the same time, the head-mounted device can enter the two-handed operation mode. At this time, the two operating devices can respectively control the left and right areas in the display interface of the head-mounted device, or the two operating devices can be controlled collaboratively. It can be understood that when the head-mounted device is in the two-handed operation mode, the display interface of the head-mounted device will become a left and right display area. For example, when the head-mounted device is AR glasses, these two display areas can be the display interfaces corresponding to the two lenses.

[0065] When the user opens a game application, music application or video application, the head-mounted device can enter the corresponding game operation mode, music playback mode and video playback mode. There is no need for the user to switch manually, which improves the convenience of interaction.

[0066] In one embodiment, those skilled in the art may pre-set the correspondence between control instructions and control operations in different operation modes, and the head mounted device may query the corresponding correspondence according to the received control instruction according to the current operation mode to determine the control operation corresponding to the received control instruction. For example, in the one-handed operation mode, the user slides right on the touch input device on the operation device to generate the corresponding control instruction, and the corresponding control operation may be to control the control cursor to slide to the right by a corresponding distance; while in the video playback mode, when the user slides right on the touch input device on the operation device to generate the corresponding control instruction, the corresponding control operation may be to fast forward the currently played video by a corresponding time, and so on.

[0067] In addition, users can also modify or edit the correspondence between control instructions and control operations based on the pre-set correspondence between control instructions and control operations according to actual needs, thereby achieving personalized settings to meet the usage habits of different users and improve user experience.

[0068] After the control operation corresponding to the received control instruction is determined, the corresponding control operation can be executed to control the head mounted device to meet the operation requirements of the user.

[0069] Therefore, in Figure 1In the illustrated embodiment, the head-mounted device can receive a control instruction sent by the operating device through communication between the head-mounted device and the operating device, and the control instruction is generated by the operating device according to the detected predetermined operation, and then the head-mounted device is controlled according to the current operation mode and the control instruction. Thus, in different operation modes (i.e., usage scenarios), the head-mounted device can convert the same control instruction into a corresponding control operation and execute it, so that the same control instruction of the operating device is applicable to different operation modes of the wearable device, i.e., applicable to different usage scenarios of the head-mounted device, thereby improving the operability of the head-mounted device and the convenience of interaction between the operating device and the head-mounted device.

[0070] In one embodiment of the present application, the method further includes:

[0071] Displaying a control cursor adapted to the operation mode on a display interface of the head mounted device;

[0072] Controlling the head mounted device according to the current operation mode of the head mounted device and the control instruction comprises:

[0073] According to the current operation mode of the head mounted device and the control instruction, the control cursor is controlled to perform actions to realize control of the head mounted device.

[0074] In this embodiment, when the head mounted device is started, a control cursor adapted to the current operation mode may be displayed in its display interface. The control cursor may be a cursor of any shape, such as a hand shape, an arrow shape, a dot shape, etc. It should be noted that in different operation modes, the control cursor may have different shapes or quantities to adapt to the operation requirements of different operation modes. For example, in a one-hand operation mode, a control cursor may be displayed in the display interface, and the initial position of the control cursor may be placed at the center of the display interface, while in a two-hand operation mode, two control cursors may be displayed in the display interface, and the two control cursors may be located in the left and right areas of the display interface, respectively, to respectively control the left and right areas, and so on.

[0075] Therefore, when the head mounted device determines the corresponding control operation, the corresponding control operation can be performed by controlling the control cursor. It should be noted that the control cursor is controlled to perform an action, and the action may include at least one of movement (including movement in any direction, such as left, right, up, down, etc.), single click, double click, and long press. Therefore, the user can intuitively know the current operation process through the control cursor, which is convenient for the user's subsequent operations and improves the user experience.

[0076] Based on the foregoing embodiment, in one embodiment of the present application, the method further includes:

[0077] If no new control instruction is received within the first predetermined time, the control cursor is restored to a default position, and the control cursor is hidden after a second predetermined time.

[0078] In this embodiment, the first predetermined time and the second predetermined time can be preset by those skilled in the art based on prior experience. After the current control operation is performed, if no new control instruction is received within the first predetermined time, the control cursor can be restored to the default position, that is, restored to the initial position, which can avoid affecting the user's current field of view and facilitate the user to quickly determine the position of the control cursor during subsequent operations and then determine how to perform subsequent operations.

[0079] Then, when the control cursor is restored to the default position, the timing starts again. If no new control instruction is received within the second predetermined time, the control cursor can be hidden. Specifically, the purpose of hiding the control cursor can be achieved by adjusting the transparency of the control cursor. In one example, the control cursor can be adjusted to be completely transparent to avoid affecting the user's current field of view; in another example, the transparency of the control cursor can also be adjusted to a predetermined value, which does not affect the user's current field of view, and the user can also know the hidden position of the control cursor for subsequent control.

[0080] In one embodiment of the present application, before receiving the control instruction sent by the operating device, the method further includes:

[0081] According to the received mode selection instruction sent by the operating device, entering the operating mode corresponding to the mode selection instruction;

[0082] or

[0083] According to the number of operating devices communicatively connected to the head mounted device, entering an operating mode corresponding to the number of the operating devices;

[0084] or

[0085] According to the application currently started by the head mounted device, an operation mode corresponding to the application is entered.

[0086] In this embodiment, the user can send a mode selection instruction to the head-mounted device through the operating device, and the head-mounted device can enter the corresponding operation mode after receiving the mode selection instruction. Specifically, the user can generate a mode editing instruction by operating the function keys on the device, for example, the user can long press the home button to generate a mode editing instruction. The operating device can send the mode editing instruction to the head-mounted device. After receiving the mode editing instruction, the head-mounted device can display a mode selection interface in the display interface, and the mode selection interface may include at least one selectable operation mode.

[0087] Then, the user can select and determine the selectable operation modes displayed on the mode selection interface by operating the device to generate a corresponding mode selection instruction. The head mounted device can determine and enter the operation mode selected by the user according to the mode selection instruction.

[0088] In one example, the head-mounted device may also enter an operation mode corresponding to the number of operating devices connected for communication with the head-mounted device. For example, if the number of operating devices connected for communication with the head-mounted device is one, the head-mounted device may enter a one-handed operation mode; if the number of operating devices connected for communication with the head-mounted device is two, the head-mounted device may enter a two-handed operation mode, and so on.

[0089] In one example, the head-mounted device can enter an operating mode corresponding to the currently launched application according to the application. For example, when the user launches a game application, the head-mounted device can enter a game operating mode. When the user launches a music playback application, the head-mounted device can enter a music playback mode, and so on.

[0090] Therefore, through the above-mentioned operation mode selection method, the operation mode can be switched based on user needs, actual usage scenarios, etc., which improves the convenience of operation mode switching and further improves user experience.

[0091] In one embodiment of the present application, the method further includes:

[0092] In response to a function editing request for a function button on the operating device, displaying a button function editing interface in a display interface, wherein the function editing interface includes function information corresponding to each of the function buttons;

[0093] Determine the function key to be edited according to the received selection information for the function key;

[0094] Based on the received function editing information for the function key to be edited, the function information corresponding to the function key to be edited is updated, wherein the function editing information includes a control instruction for controlling the action of the control cursor.

[0095] In this embodiment, due to different user usage habits or usage scenarios, the user can customize the function of the function button on the operating device for easy control. Specifically, the user can generate a function editing request by operating the function button on the device and send it to the head mounted device. After receiving the function editing request, the head mounted device can display a button function editing interface in the display interface, and the button function editing interface can include each function button and corresponding function information.

[0096] The user can select in the button function editing interface by operating the device to generate selection information for the function button, and the head mounted device can determine the function button to be edited according to the received selection information for the function button. For example, if the operating device is configured with a scroll wheel, a home button, and an auxiliary button, the user can select to edit the function information of the scroll wheel in the above manner.

[0097] After determining the function button to be edited, the user can input the corresponding function editing information by operating the device. In one example, after determining the function button to be edited, the head mounted device can display the selectable function information of the current function button to be edited in the display interface, such as sliding left, sliding right, single-clicking, double-clicking, single-clicking a specific area, etc.

[0098] The user can select or combine the selectable function information of the function button to be edited. By combining the function information, the purpose of triggering a function button once can be realized to realize multiple functions, which improves the convenience of control. And when combining, the execution order and execution interval of each function can also be determined.

[0099] Thus, corresponding function editing information can be generated according to the corresponding operation of the user, and the function editing information can include a control instruction for controlling the cursor action. Then, the head mounted device can update the function information corresponding to the function button to be edited according to the received function editing information.

[0100] Therefore, through the above embodiments, the user can customize the function information of each function button according to actual needs, which is convenient for the user's operation and improves the interactivity between the operating device and the head-mounted device.

[0101] In one embodiment of the present application, controlling the head mounted device according to the current operation mode of the head mounted device and the control instruction includes:

[0102] When the control instruction is generated based on the sliding operation, controlling the head mounted device to perform an operation of a first function corresponding to the sliding operation in the operation mode;

[0103] When the control instruction is generated based on a click operation, controlling the head mounted device to perform an operation of a second function corresponding to the click operation in the operation mode, wherein the click operation includes a single click operation and a double click operation;

[0104] When the control instruction is generated based on a long press operation, controlling the head mounted device to perform an operation of a third function corresponding to the long press operation in the operation mode;

[0105] When the control instruction is generated based on the scrolling operation, the head mounted device is controlled to perform an operation of a fourth function corresponding to the scrolling operation in the operation mode.

[0106] In this embodiment, the user can implement different operations through the operating device, such as sliding operation, clicking operation, long pressing operation, scrolling operation, etc., wherein the clicking operation can be a single click operation, a double click operation, or a triple click operation, etc. The operating device can generate corresponding control instructions according to different operations and send them to the head mounted device.

[0107] It should be understood that according to the control instructions generated by different operations, the head-mounted device can perform operations of different functions. For example, when the control instruction is generated based on a sliding operation, the head-mounted device can perform an operation of the first function corresponding to the sliding operation, such as moving a control cursor, etc.; when the control instruction is generated based on a click operation, the head-mounted device can perform an operation of the second function corresponding to the click operation, such as clicking a specific area, etc. The click operation includes a single-click operation and a double-click operation; when the control instruction is generated based on a long press operation, the head-mounted device can perform an operation of the third function corresponding to the long press operation, such as long pressing an application icon to enter an editing mode, etc.; when the control instruction is generated based on a scrolling operation, the head-mounted device can perform an operation of the fourth function corresponding to the scrolling operation, such as sliding the currently displayed page, etc.

[0108] In this way, the diversity of user operations can be ensured, avoiding setting only a single operation mode, improving the operability of the head-mounted device and enhancing the user experience.

[0109] In one embodiment of the present application, a device interaction method is also provided. The method is applied to an operating device, and the operating device is communicatively connected to a head-mounted device.

[0110] The method includes:

[0111] generating a control instruction according to the detected predetermined operation;

[0112] The control instruction is sent to the head mounted device, so that the head mounted device is controlled accordingly according to the current operation mode and the control instruction.

[0113] For details not disclosed in the embodiment of the interaction method applied to the operating device of the present application, please refer to the above-mentioned embodiment of the interaction method applied to the head-mounted device of the present application, and the present application will not repeat them here.

[0114] Based on the technical solutions of the above embodiments, the specific application scenarios of the embodiments of the present application are introduced below:

[0115] The following description takes the head-mounted device as smart glasses and the operating device as a smart ring as an example. The smart ring may be provided with function buttons such as a sliding wheel, a home button, and an auxiliary button.

[0116] In one embodiment, the user can wear one or two rings to control the head-mounted device.

[0117] For example, the user can wear the first ring and the second ring on the left and right hands respectively, and the user can long press the home button on the smart rings at the same time to connect with the smart glasses respectively. When the use is over, the user can long press the home button at the same time to disconnect from the smart glasses.

[0118] When the smart glasses are started, two control cursors on the left and right are presented on the screen of the smart glasses, and the control cursors can be presented in the form of dots (i.e., focus). The first finger ring and the second finger ring can control the corresponding control cursors respectively. The user can touch the scroll wheel on the smart ring, and the smart glasses can move the focus according to the scrolling direction of the scroll wheel. The user can control the control cursor to implement a certain function by pressing the scroll wheel. When the user's finger leaves the scroll wheel, the control cursor can be restored to the default position. In addition, the active area of ​​the control cursor on the left is limited to the left half of the screen. Similarly, the active area of ​​the control cursor on the right is limited to the right half of the screen. It should be understood that when only one ring is worn, only one control cursor is presented on the screen of the smart glasses.

[0119] In addition, users can send a return to home page command to the smart glasses by clicking the home button, and the smart glasses can return to the previous menu according to the command. If the home button is double-clicked continuously, all background processes can be displayed on the screen, and users can choose to enter or close a certain process.

[0120] In one example, the auxiliary keys may include an LT key and a RT key (i.e., the LT key is the left auxiliary key and the RT key is the right auxiliary key). When the LT key is clicked, a volume reduction instruction may be sent to the smart glasses, and when the RT key is clicked, a volume increase instruction may be sent to the smart glasses, so that the smart glasses adjust the volume accordingly.

[0121] In addition, users can set the functions of the auxiliary keys on the smart ring through the application. For example, when the auxiliary key is triggered, the cursor can be controlled to click a fixed position on the screen. The number of clicks, click duration, or sliding clicks can also be set. It is also possible to set the triggering of a certain auxiliary key to continuously operate different events, etc., to meet the different usage needs of users. For example, users can customize the settings of "single click LT", "double click LT", "long press LT", "single click RT", "double click RT" and "long press RT" for a total of 6 actions. According to the action, relevant instructions can be sent to the smart glasses. The instructions can include volume adjustment, silent mode activation, brightness adjustment, flight mode, recording activation, camera activation, timer activation, music activation, and launching a certain application, etc.

[0122] When entering the viewing mode, the user can click the wheel to send a pause or continue playback instruction to the smart glasses while the video is playing. When the wheel is long pressed and moved left and right, the playback progress of the video can be controlled. When the user slides the wheel left and right, a volume adjustment instruction can be sent to the smart glasses, and the smart glasses can adjust the volume according to the direction of the wheel sliding. Slide the wheel up and down, and a brightness adjustment instruction can be sent to the smart glasses, and the smart glasses adjust the brightness according to the direction of the wheel sliding. In one example, when the head-mounted device is in the game operation mode, when the user wears two smart rings, the smart glasses can display two spherical focuses (i.e., control cursors). By sliding the wheel of the first ring on the left hand, a control instruction in the corresponding direction can be sent to the smart glasses to realize the movement of the game character. By sliding the wheel of the second ring on the right hand, an instruction in the corresponding direction can be sent to the smart glasses to realize the skill release of the game character.

[0123] Users can also click the home button on the smart ring to make the smart glasses return to the previous menu according to the control command. Double-clicking the home button continuously can make the smart glasses display all background processes. Users can also use the auxiliary button on the smart ring to adjust the volume. In addition, users can customize the function information of the auxiliary button to realize functions such as automatic purchase of equipment, viewing battle information, automatic switching of equipment, returning to the base, restoring health, and releasing skills to improve the convenience of operation.

[0124] The following describes an apparatus embodiment of the present application, which can be used to execute the interactive method of the device in the above-mentioned embodiment of the present application. For details not disclosed in the apparatus embodiment of the present application, please refer to the embodiment of the interactive method of the device in the above-mentioned embodiment of the present application.

[0125] Figure 2 A block diagram of an interaction device of a device according to an embodiment of the present application is shown, where the device is applied to a head-mounted device, which is communicatively connected to at least one operating device.

[0126] The interactive device of the device includes:

[0127] A receiving module 210, configured to receive a control instruction sent by the operating device, wherein the control instruction is generated by the operating device according to a detected predetermined operation;

[0128] The processing module 220 is used to control the head mounted device according to the current operation mode of the head mounted device and the control instruction.

[0129] In one embodiment of the present application, the processing module 220 is further configured to: display a control cursor adapted to the operation mode on a display interface of the head mounted device;

[0130] The processing module 220 is used to control the control cursor to move according to the current operation mode of the head mounted device and the control instruction so as to control the head mounted device.

[0131] In one embodiment of the present application, the processing module 220 is further configured to: if no new control instruction is received within a first predetermined time, restore the control cursor to a default position, and hide the control cursor after a second predetermined time.

[0132] In one embodiment of the present application, before receiving the control instruction sent by the operating device, the processing module 220 is further configured to:

[0133] According to the received mode selection instruction sent by the operating device, entering the operating mode corresponding to the mode selection instruction;

[0134] or

[0135] According to the number of operating devices communicatively connected to the head mounted device, entering an operating mode corresponding to the number of the operating devices;

[0136] or

[0137] According to the application currently started by the head mounted device, an operation mode corresponding to the application is entered.

[0138] In one embodiment of the present application, the processing module 220 is further configured to:

[0139] In response to a function editing request for a function button on the operating device, displaying a button function editing interface in a display interface, wherein the button function editing interface includes each of the function buttons and corresponding function information;

[0140] Determine the function key to be edited according to the received selection information for the function key;

[0141] Based on the received function editing information for the function key to be edited, the function information corresponding to the function key to be edited is updated, wherein the function editing information includes a control instruction for controlling the action of the control cursor.

[0142] In one embodiment of the present application, the processing module 220 is used to:

[0143] When the control instruction is generated based on the sliding operation, controlling the head mounted device to perform an operation of a first function corresponding to the sliding operation in the operation mode;

[0144] When the control instruction is generated based on a click operation, controlling the head mounted device to perform an operation of a second function corresponding to the click operation in the operation mode, wherein the click operation includes a single click operation and a double click operation;

[0145] When the control instruction is generated based on a long press operation, controlling the head mounted device to perform an operation of a third function corresponding to the long press operation in the operation mode;

[0146] When the control instruction is generated based on the scrolling operation, the head mounted device is controlled to perform an operation of a fourth function corresponding to the scrolling operation in the operation mode.

[0147] According to another embodiment of the present application, there is also provided an interactive device for a device, which is applied to an operating device, wherein the operating device is communicatively connected to a head mounted device;

[0148] The interactive device comprises:

[0149] A generating module, used for generating a control instruction according to the detected predetermined operation;

[0150] The sending module is used to send the control instruction to the head mounted device, so that the head mounted device can realize corresponding control according to the current operation mode and the control instruction.

[0151] In one embodiment of the present application, an electronic device is further provided, the electronic device comprising:

[0152] one or more processors;

[0153] A storage device is used to store one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors implement the interaction method of the device as described in the above embodiments.

[0154] In one example, Figure 3 A schematic diagram of the structure of a computer system suitable for implementing an electronic device of an embodiment of the present application is shown.

[0155] It should be noted that Figure 3 The computer system 500 of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0156] like Figure 3 As shown, the computer system 500 includes a central processing unit (CPU) 501 (i.e., the processor as described above), which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 502 or the program loaded from the storage part 508 to the random access memory (RAM) 503, such as executing the interactive method of the device described in the above embodiment. It should be understood that ROM 502 and RAM 503 are the storage devices as described above. In RAM 503, various programs and data required for system operation are also stored. CPU 501, ROM 502 and RAM 503 are connected to each other through bus 504. Input / output (I / O) interface 505 is also connected to bus 504.

[0157] The following components are connected to the I / O interface 505: an input section 506 including a keyboard, a mouse, etc.; an output section 507 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 508 including a hard disk, etc.; and a communication section 509 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 509 performs communication processing via a network such as the Internet. A drive 510 is also connected to the I / O interface 505 as needed. A removable medium 511, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 510 as needed so that a computer program read therefrom is installed into the storage section 508 as needed.

[0158] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication section 509, and / or installed from a removable medium 511. When the computer program is executed by a central processing unit (CPU) 501, various functions defined in the system of the present application are executed.

[0159] It should be noted that the computer-readable medium shown in the embodiment of the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, - but not limited to - an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by an instruction execution system, device or device or used in combination with it. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a computer-readable computer program is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate, or transmit programs for use by or in conjunction with an instruction execution system, apparatus, or device. The computer program contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0160] The flowchart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present application. Wherein, each box in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0161] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. The names of these units do not, in some cases, constitute limitations on the units themselves.

[0162] As another aspect, the present application also provides a computer-readable medium, which may be included in the electronic device described in the above embodiment; or may exist independently without being assembled into the electronic device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by an electronic device, the electronic device implements the device interaction method described in the above embodiment.

[0163] It should be noted that, although several modules or units of the equipment for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into being embodied by multiple modules or units.

[0164] Through the description of the above implementation methods, it is easy for those skilled in the art to understand that the example implementation methods described here can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the implementation methods of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the implementation methods of the present application.

[0165] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the embodiments disclosed herein. The present application is intended to cover any variations, uses or adaptations of the present application, which follow the general principles of the present application and include common knowledge or customary technical means in the art that are not disclosed in the present application.

[0166] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A device interaction method, characterized in that: Applicable to a head mounted device, the head mounted device is communicatively connected to at least one operating device; The method comprises: receiving a control instruction sent by the operating device, wherein the control instruction is generated by the operating device according to a detected predetermined operation; The head mounted device is controlled according to a current operation mode of the head mounted device and the control instruction.

2. The method according to claim 1, characterized in that The method further comprises: Displaying a control cursor adapted to the operation mode on a display interface of the head mounted device; Controlling the head mounted device according to the current operation mode of the head mounted device and the control instruction comprises: According to the current operation mode of the head mounted device and the control instruction, the control cursor is controlled to perform actions to control the head mounted device.

3. The method according to claim 2, characterized in that The method further comprises: If no new control instruction is received within the first predetermined time, the control cursor is restored to a default position, and the control cursor is hidden after a second predetermined time.

4. The method according to claim 1, characterized in that: Before receiving the control instruction sent by the operating device, the method further includes: According to the received mode selection instruction sent by the operating device, entering the operating mode corresponding to the mode selection instruction; or According to the number of operating devices communicatively connected to the head mounted device, entering an operating mode corresponding to the number of the operating devices; or According to the application currently started by the head mounted device, an operation mode corresponding to the application is entered.

5. The method according to claim 1, characterized in that The method further comprises: In response to a function editing request for a function button on the operating device, displaying a button function editing interface in a display interface, wherein the button function editing interface includes each of the function buttons and corresponding function information; Determine the function key to be edited according to the received selection information for the function key; Based on the received function editing information for the function key to be edited, the function information corresponding to the function key to be edited is updated, wherein the function editing information includes a control instruction for controlling the action of the control cursor.

6. The method according to claim 1, characterized in that Controlling the head mounted device according to the current operation mode of the head mounted device and the control instruction comprises: When the control instruction is generated based on the sliding operation, controlling the head mounted device to perform an operation of a first function corresponding to the sliding operation in the operation mode; When the control instruction is generated based on a click operation, controlling the head mounted device to perform an operation of a second function corresponding to the click operation in the operation mode, wherein the click operation includes a single click operation and a double click operation; When the control instruction is generated based on a long press operation, controlling the head mounted device to perform an operation of a third function corresponding to the long press operation in the operation mode; When the control instruction is generated based on the scrolling operation, the head mounted device is controlled to perform an operation of a fourth function corresponding to the scrolling operation in the operation mode.

7. A device interaction method, characterized in that: Applicable to an operating device, wherein the operating device is communicatively connected with a head mounted device; The method comprises: generating a control instruction according to the detected predetermined operation; The control instruction is sent to the head mounted device, so that the head mounted device is controlled accordingly according to the current operation mode and the control instruction.

8. An interactive device for a device, characterized in that: Applicable to a head mounted device, the head mounted device is communicatively connected to at least one operating device; The interactive device comprises: A receiving module, used for receiving a control instruction sent by the operating device, wherein the control instruction is generated by the operating device according to a detected predetermined operation; A processing module controls the head mounted device according to a current operation mode of the head mounted device and the control instruction.

9. A computer readable medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the interaction method of the device according to any one of claims 1 to 6 and 7 is implemented.

10. An electronic device, characterized in that: include: one or more processors; A storage device for storing one or more programs, which, when executed by the one or more processors, enables the one or more processors to implement the interaction method of the device as described in any one of claims 1-6 and 7.

Images