Device control method, electronic device, and computer-readable storage medium

Abstract

The application discloses a device control method, an electronic device and a computer readable storage medium, and is applied to an AR device. The device control method comprises the following steps: identifying a target device according to a first gaze point direction of a wearing user of the AR device in a real space; and controlling the AR device to connect the target device and send a control instruction to the target device. The application solves the technical problem of low connection simplicity of a smart terminal device.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of AR (Augmented Reality) technology, and particularly relates to a device control method, an electronic device and a computer readable storage medium. BACKGROUND

[0002] With the continuous development of random technology, intelligent terminal devices gradually become common intelligent devices for people. At present, when connecting an intelligent terminal device, a user usually manually operates a mobile terminal (such as a mobile phone or a bracelet) to search for a connection signal of the intelligent terminal device, so as to connect the intelligent terminal device through the mobile terminal. However, when the user's hands are occupied, the user is usually inconvenient to manually operate to connect the intelligent terminal device, which affects the connection convenience of the intelligent terminal device. SUMMARY

[0003] The main purpose of the present application is to provide a device control method, an electronic device and a computer readable storage medium, aiming at solving the technical problem of low connection convenience of the intelligent terminal device in the prior art.

[0004] To achieve the above-mentioned purpose, the present application provides a device control method applied to an AR device, the device control method comprising:

[0005] According to a first gaze point direction of a wearing user of the AR device in a real space, a target device is identified;

[0006] The AR device is controlled to connect the target device, and a control instruction is sent to the target device.

[0007] Optionally, the step of identifying the target device according to the first gaze point direction of the wearing user of the AR device in the real space comprises:

[0008] Position information of a terminal device is acquired;

[0009] If the position information of the terminal device matches the first gaze point direction, the terminal device is identified as the target device.

[0010] Optionally, the position information comprises a terminal device direction, and after the step of acquiring the position information of the terminal device, the method further comprises:

[0011] A first direction included angle between the terminal device direction and the first gaze point direction is calculated;

[0012] If the first direction included angle is within a preset included angle range, it is determined that the position information of the terminal device matches the first gaze point direction.

[0013] Optionally, the step of identifying the target device according to the first gaze point direction of the user wearing the AR device in the real space comprises:

[0014] acquiring position information of the terminal device, and determining a preselected terminal device matching the position information and the first gaze point direction;

[0015] if the number of the preselected terminal devices is not multiple, identifying the preselected terminal device as the target device;

[0016] if the number of the preselected terminal devices is multiple, locally magnifying the AR display screen in the first gaze point direction, and determining a second gaze point direction of the user wearing the AR device in the real space;

[0017] identifying the target device from the preselected terminal devices according to the second gaze point direction.

[0018] Optionally, the position information comprises a terminal device direction, and the step of identifying the target device from the preselected terminal devices according to the second gaze point direction comprises:

[0019] correcting the first gaze point direction according to the second gaze point direction to obtain a corrected gaze point direction;

[0020] calculating a second direction included angle between the corrected gaze point direction and the terminal device direction of each preselected terminal device;

[0021] selecting the target device from the preselected terminal devices according to the second direction included angle.

[0022] Optionally, the step of controlling the AR device to connect the target device comprises:

[0023] pushing a connection prompt information to the user wearing the AR device, wherein the connection prompt information is used to prompt the user to select whether to connect the target device;

[0024] controlling the AR device to connect the target device according to the confirmation connection information fed back by the user wearing the AR device.

[0025] Optionally, the step of sending the control instruction to the target device comprises:

[0026] receiving the device function information sent by the target device, and displaying the device function information;

[0027] sending the corresponding control instruction to the target device according to the feedback information of the user wearing the AR device on the device function information.

[0028] Optionally, the AR device comprises an antenna array, the antenna array comprises a first array element and a second array element, the terminal device comprises a Bluetooth device, the position information comprises a Bluetooth device direction angle,

[0029] The step of obtaining the position information of the terminal device comprises:

[0030] Obtaining a signal wavelength corresponding to the Bluetooth signal emitted by the Bluetooth device, a relative distance between the first array element and the second array element, and a phase difference generated when the Bluetooth signal reaches the first array element and the second array element;

[0031] According to the signal wavelength, the relative distance, and the phase difference, a Bluetooth device direction angle corresponding to the Bluetooth device is calculated.

[0032] To achieve the above-mentioned purposes, the application further provides a device control apparatus applied to an AR device, the device control apparatus comprising:

[0033] An identification module is configured to identify a target device according to a first gaze point direction of a user wearing the AR device in a real space.

[0034] A control module is configured to control the AR device to connect to the target device and send a control instruction to the target device.

[0035] Optionally, the identification module is further configured to:

[0036] Obtain position information of a terminal device.

[0037] If the position information of the terminal device matches the first gaze point direction, the terminal device is identified as the target device.

[0038] Optionally, the position information comprises a terminal device direction, and the identification module is further configured to:

[0039] Calculate a first direction angle between the terminal device direction and the first gaze point direction.

[0040] If the first direction angle is within a preset angle range, it is determined that the position information of the terminal device matches the first gaze point direction.

[0041] Optionally, the identification module is further configured to:

[0042] Obtain position information of a terminal device, and determine a pre-selected terminal device whose position information matches the first gaze point direction.

[0043] If the number of the pre-selected terminal devices is not multiple, the pre-selected terminal device is identified as the target device.

[0044] If the number of the pre-selected terminal devices is multiple, the AR display picture in the first gaze point direction is partially enlarged, and a second gaze point direction of a user wearing the AR device in a real space is determined;

[0045] According to the second gaze point direction, a target device is identified from the pre-selected terminal devices.

[0046] Optionally, the position information comprises a terminal device direction, and the identification module is further configured to:

[0047] According to the second gaze point direction, the first gaze point direction is corrected to obtain a corrected gaze point direction;

[0048] A second direction included angle between the corrected gaze point direction and a terminal device direction of each pre-selected terminal device is calculated.

[0049] According to the second direction included angle, a target device is selected from the pre-selected terminal devices.

[0050] Optionally, the control module is further configured to:

[0051] Push connection prompt information to the user wearing the AR device, wherein the connection prompt information is used to prompt the user to select whether to connect the target device;

[0052] According to the confirmation connection information fed back by the user wearing the AR device, the AR device is controlled to connect the target device.

[0053] Optionally, the control module is further configured to:

[0054] Receive device function information sent by the target device, and display the device function information;

[0055] According to the feedback information of the user wearing the AR device on the device function information, a corresponding control instruction is sent to the target device.

[0056] Optionally, the AR device comprises an antenna array, the antenna array comprises a first array element and a second array element, the terminal device comprises a Bluetooth device, the position information comprises a Bluetooth device direction angle, and the identification module is further configured to:

[0057] Obtain a signal wavelength corresponding to a Bluetooth signal emitted by the Bluetooth device, a relative distance between the first array element and the second array element, and a phase difference generated when the Bluetooth signal reaches the first array element and the second array element;

[0058] According to the signal wavelength, the relative distance, and the phase difference, a Bluetooth device direction angle corresponding to the Bluetooth device is calculated.

[0059] The application further provides an electronic device, which is a physical device, and the electronic device comprises a memory, a processor, and a program of the device control method stored in the memory and executable on the processor, and the program of the device control method can realize the steps of the device control method when executed by the processor.

[0060] The application further provides a computer readable storage medium, which stores a program of a device control method, and the program of the device control method can realize the steps of the device control method when executed by a processor.

[0061] The application further provides a computer program product, which comprises a computer program, and the computer program can realize the steps of the device control method when executed by a processor.

[0062] The application provides a device control method, an electronic device, and a computer readable storage medium. First, a target device is identified according to a first gaze point direction of a user wearing an AR device in a real space. The AR device is controlled to connect the target device and send a control instruction to the target device. In this way, the application automatically connects a target device that the user wearing the AR device wants to connect by identifying the gaze direction of the user wearing the AR device. The user only needs to gaze at the terminal device to be connected to complete the automatic connection of the terminal device, without manual operation. Therefore, the technical defect that the user is usually not convenient to manually connect the smart terminal device when the user's hands are occupied, affecting the connection convenience of the smart terminal device, is overcome, and the connection convenience of the smart terminal device is improved. BRIEF DESCRIPTION OF DRAWINGS

[0063] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and serve to explain the principles of the application together with the specification.

[0064] In order to more clearly illustrate the technical solutions in the embodiments of the application or the prior art, the accompanying drawings needed to be used in the embodiments or prior art description will be briefly introduced as follows. Obviously, for those skilled in the art, other drawings can also be obtained based on these drawings without creative labor.

[0065] Figure 1 A flowchart of a first embodiment of the device control method of the application is shown in the figure.

[0066] Figure 2 A schematic diagram of determining the direction of a Bluetooth device by using a first array element and a second array element in the device control method of the application is shown in the figure.

[0067] Figure 3A flowchart of a second embodiment of the device control method of the present application;

[0068] Figure 4 A device structure diagram of a hardware operating environment involved in the device control method of the embodiments of the present application.

[0069] The object implementation, functional features and advantages of the present application will be further described with reference to the embodiments and the accompanying drawings. DETAILED DESCRIPTION

[0070] In order to make the above object, features and advantages of the present application more apparent, clear and complete, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

[0071] Embodiment One

[0072] The embodiments of the present application provide a device control method applied to an AR device, which refers to Figure 1 In the first embodiment of the device control method of the present application, the device control method comprises:

[0073] Step S10, identifying a target device according to a first gaze point direction of a wearing user of the AR device in a real space;

[0074] Step S20, controlling the AR device to connect the target device and send a control instruction to the target device.

[0075] In the present embodiment, it is to be noted that the target device can be a terminal device with Bluetooth function, and the AR device is provided with Bluetooth orientation function, which is used to locate the position information of the terminal device relative to the AR device according to the Bluetooth signal emitted by the terminal device, and the position information can be direction information or distance information, etc. The AR device is also provided with an eye movement tracking module, which is used to track the eye movement of the wearing user of the AR device to obtain the gaze point direction of the wearing user of the AR device.

[0076] As an example, steps S10 to S20 include: detecting position information of each terminal device within a Bluetooth signal coverage range of the AR device through a Bluetooth homing function of the AR device; detecting a first gaze point direction of a wearing user of the AR device in a real space through eye tracking of the wearing user; identifying a target device from the terminal devices according to the position information and the first gaze point direction; controlling the AR device to connect to the target device and send a control instruction to the target device. In the embodiment of the application, the entire process of controlling the AR device to connect to the terminal device through Bluetooth does not require manual operation of the user, thereby achieving a seamless connection between the AR device and the terminal device and improving user experience.

[0077] The step of identifying the target device according to the first gaze point direction of the wearing user of the AR device in the real space includes:

[0078] Step S11: acquiring position information of the terminal device.

[0079] Step S12: identifying the terminal device as the target device if the position information of the terminal device matches the first gaze point direction.

[0080] As an example, steps S11 to S12 include: acquiring position information of the terminal device, which can be direction information or position information; detecting whether the position information of the terminal device matches the first gaze point direction; identifying the terminal device as the target device if the position information of the terminal device matches the first gaze point direction; and not identifying the terminal device as the target device if the position information of the terminal device does not match the first gaze point direction.

[0081] The position information includes a terminal device direction, and after the step of acquiring the position information of the terminal device, the method further includes:

[0082] Step A10: calculating a first direction included angle between the terminal device direction and the first gaze point direction.

[0083] Step A20: determining that the position information of the terminal device matches the first gaze point direction if the first direction included angle is within a preset included angle range.

[0084] As an example, steps S321 to S322 include: calculating an included angle between the terminal device direction and the first gaze point direction, to obtain a first direction included angle; if the first direction included angle is within a preset included angle range, determining that the position information of the terminal device matches the first gaze point direction; if the first direction included angle is not within the preset included angle range, determining that the position information of the terminal device does not match the first gaze point direction. For example, it is assumed that the terminal device direction and the first gaze point direction are both represented by an angle of deviation from the vertical direction of the AR device, the terminal device direction is 10 degrees to the left, and the first gaze point direction is 30 degrees to the left, and the first direction included angle is 20 degrees.

[0085] The step of controlling the AR device to connect the target device includes:

[0086] Step S21: pushing connection prompt information to the wearing user, wherein the connection prompt information is used to prompt the user to select whether to connect the target device.

[0087] Step S22: controlling the AR device to connect the target device according to the confirmation connection information fed back by the wearing user.

[0088] As an example, steps S21 to S22 include: pushing connection prompt information to the wearing user, wherein the connection prompt information is used to prompt the user to select whether to connect the target device, and the connection prompt information can be visual information or voice information; if the confirmation connection information fed back by the wearing user is received, the AR device is controlled to connect the target device.

[0089] The step of sending a control instruction to the target device includes:

[0090] Step B10: receiving device function information sent by the target device and displaying the device function information.

[0091] Step B20: sending a corresponding control instruction to the target device according to the feedback information of the wearing user on the device function information.

[0092] As an example, the step B10 includes the step B20, which comprises: receiving device function information sent by the target device; displaying a device function adjustment interface corresponding to the device function information through the AR device according to the device function information; and sending corresponding control instructions to the target device through the AR device according to feedback information of the wearing user in the device function adjustment interface, so as to control the target device to perform corresponding functions. The feedback information can be click selection information or voice selection information. For example, if the target device is an air conditioner, the device function information can be temperature adjustment information, humidity adjustment information, air conditioner mode adjustment information, etc. If the target device is a television, the device function information can be volume adjustment information, video brightness adjustment information, and television channel switching information, etc.

[0093] The AR device includes an antenna array, the antenna array includes a first array element and a second array element, the device position information includes a Bluetooth device direction angle, and the terminal device includes a Bluetooth device,

[0094] The step of obtaining the position information of the terminal device comprises:

[0095] The step S11 comprises: obtaining a signal wavelength of the Bluetooth signal sent by the Bluetooth device, a relative distance between the first array element and the second array element, and a phase difference generated when the Bluetooth signal reaches the first array element and the second array element.

[0096] The step S12 comprises: calculating the Bluetooth device direction angle corresponding to the Bluetooth device according to the signal wavelength, the relative distance, and the phase difference.

[0097] As an example, the steps S11 to S22 comprise: collecting the Bluetooth signal sent by the Bluetooth device through the first array element to obtain a first collection signal, collecting the Bluetooth signal sent by the Bluetooth device through the first array element to obtain a second collection signal, and calculating a phase difference between the first collection signal and the second collection signal; obtaining a signal wavelength of the Bluetooth signal sent by the Bluetooth device, and calculating the Bluetooth device direction angle corresponding to the Bluetooth device according to the signal wavelength, the relative distance, and the phase difference. The Bluetooth device direction angle represents a terminal device direction angle of the terminal device corresponding to the terminal device.

[0098] As an example, referring to Figure 2 , Antenna1 is the first array element, and Antenna2 is the second array element,

[0099] The calculation process of the Bluetooth device direction angle corresponding to the Bluetooth device according to the signal wavelength, the relative distance, and the phase difference is as follows:

[0100]

[0101] wherein, θ is the direction angle of the Bluetooth device, which can be specifically the deviation angle of the terminal device direction relative to the video direction of the AR device, λ is the signal wavelength, Δφ is the phase difference, and d is the relative distance between the first array element and the second array element.

[0102] The device control method provided in the embodiments of the present application first identifies a target device according to the first gaze point direction of the user wearing the AR device in the real space, controls the AR device to connect the target device, and sends a control instruction to the target device. In this way, the embodiments of the present application realize automatic connection of the target device that the user wearing the AR device wants to connect by identifying the gaze direction of the user wearing the AR device, and the user can complete the automatic connection of the terminal device only by gazing at the terminal device that needs to be connected, without manual operation of the user. Therefore, the technical defect that the user is usually not convenient to connect the intelligent terminal device by manual operation when the user's hands are in an occupied state, which affects the connection convenience of the intelligent terminal device, is overcome, and the connection convenience of the intelligent terminal device is improved.

[0103] Embodiment Two

[0104] With reference to Figure 3 Based on the first embodiment of the present application, in another embodiment of the present application, the step of identifying a target device according to the first gaze point direction of the user wearing the AR device in the real space comprises:

[0105] Step C10, acquiring position information of a terminal device, and determining a preselected terminal device that matches the position information and the first gaze point direction;

[0106] Step C20, if the number of the preselected terminal devices is not multiple, identifying the preselected terminal device as a target device;

[0107] Step C30, if the number of the preselected terminal devices is multiple, locally magnifying the AR display picture in the first gaze point direction, and determining a second gaze point direction of the user wearing the AR device in the real space;

[0108] Step C40, identifying a target device from the preselected terminal devices according to the second gaze point direction.

[0109] In this embodiment, it should be noted that the number of terminal devices that match the position information and the first gaze point direction can be multiple, and it is difficult to directly determine which terminal device the user wants to connect from the multiple terminal devices. The position information can be the terminal device direction.

[0110] As an example, steps C10 to C40 include: obtaining the terminal device orientation corresponding to each terminal device; calculating the angle between each terminal device orientation and the first gaze point orientation to obtain the angle of each first orientation; selecting the terminal devices corresponding to the first orientation angles within a preset angle range as pre-selected terminal devices; if the number of pre-selected terminal devices is not multiple, it proves that there is only one terminal device in the first gaze point orientation of the user, and thus directly identifying the terminal device as the target device; if the number of pre-selected terminal devices is multiple, it proves that there are multiple terminal devices in the first gaze point orientation of the user, then the AR display image in the first gaze point orientation is partially magnified to obtain a partially magnified display image, and by performing eye tracking on the user, the gaze orientation of the user in real space is re-detected to obtain the second gaze point orientation; and identifying the target device among the pre-selected terminal devices according to the second gaze point orientation.

[0111] As an example, the step of identifying the target device among the pre-selected terminal devices based on the second gaze direction includes:

[0112] Based on the second gaze point direction, the target device that the wearer of the AR device is looking at is determined in the partially magnified display screen, and the target device is identified as the target device.

[0113] As an example, the step of partially magnifying the AR display image in the direction of the first gaze point to obtain a partially magnified display image includes:

[0114] An image is captured with the first gaze point as the image center, and the captured image is then magnified to obtain a magnified display screen.

[0115] The location information includes the orientation of the terminal device, and the step of identifying the target device among the pre-selected terminal devices based on the second gaze point orientation includes:

[0116] Step C41: Based on the second gaze point direction, correct the first gaze point direction to obtain the corrected gaze point direction;

[0117] Step C42: Calculate the second direction angle between the corrected gaze point direction and the terminal device direction of each of the pre-selected terminal devices;

[0118] Step C43: Select a target device from the pre-selected terminal devices according to the included angles of each of the second directions.

[0119] In the embodiment, it is to be explained that the second gaze point direction is the gaze point direction of the user wearing the AR device to the AR display picture after local magnification, and since the AR display picture is captured with the first gaze point direction as the image center, the first gaze point direction is consistent with the gaze direction of the user wearing the AR device to the picture center of the AR display picture after local magnification.

[0120] As an example, steps A31 to A33 include: calculating the gaze direction included angle between the second gaze point direction and the gaze direction of the user wearing the AR device to the picture center of the AR display picture after local magnification; correcting the first gaze point direction according to the gaze direction included angle to obtain a corrected gaze point direction, wherein the greater the gaze direction included angle, the greater the correction amplitude of the correction of the first gaze point direction; calculating the second direction included angle between the corrected gaze point direction and the terminal device direction of each preselected terminal device; and identifying the preselected terminal device corresponding to the minimum second direction included angle as the target device.

[0121] The embodiment of the application provides a device control method, i.e., acquiring the position information of the terminal device, determining the preselected terminal device matched with the first gaze point direction; if the number of the preselected terminal devices is not multiple, identifying the preselected terminal device as the target device; if the number of the preselected terminal devices is multiple, performing local magnification on the AR display picture in the first gaze point direction, and determining the second gaze point direction of the user wearing the AR device in the real space; and identifying the target device from the preselected terminal devices according to the second gaze point direction, which realizes that when there are multiple terminal devices in the gaze point direction of the user, the AR display picture after local magnification is displayed, the second gaze point direction of the user to the AR display picture after local magnification is acquired, the first gaze point direction is corrected according to the second gaze point direction, the corrected first gaze point direction is more accurate, and thus the preselected terminal device corresponding to the minimum second direction included angle can be accurately identified as the target device according to the second direction included angle between the corrected first gaze point direction and each terminal device, so that the problem that the target device cannot be accurately determined when there are multiple terminal devices in the first gaze point direction is solved, the positioning interference problem of the target device by other terminal devices near the target device is solved, and the accuracy of positioning the target device when the smart terminal device is connected is improved.

[0122] Embodiment three

[0123] The application further provides a device control apparatus applied to an AR device, and the device control apparatus comprises:

[0124] An identifying module is configured to identify a target device according to a first gaze point direction of a user wearing the AR device in a real space;

[0125] A control module is configured to control the AR device to connect to the target device and send a control instruction to the target device.

[0126] Optionally, the identifying module is further configured to:

[0127] Obtain position information of a terminal device;

[0128] If the position information of the terminal device matches the first gaze point direction, identify the terminal device as the target device.

[0129] Optionally, the position information comprises a terminal device direction, and the identifying module is further configured to:

[0130] Calculate a first direction included angle between the terminal device direction and the first gaze point direction;

[0131] If the first direction included angle is within a preset included angle range, determine that the position information of the terminal device matches the first gaze point direction.

[0132] Optionally, the identifying module is further configured to:

[0133] Obtain position information of a terminal device, and determine a preselected terminal device whose position information matches the first gaze point direction;

[0134] If the number of the preselected terminal devices is not multiple, identify the preselected terminal device as the target device;

[0135] If the number of the preselected terminal devices is multiple, locally magnify an AR display screen in the first gaze point direction, and determine a second gaze point direction of the user wearing the AR device in the real space;

[0136] According to the second gaze point direction, identify a target device from the preselected terminal devices.

[0137] Optionally, the position information comprises a terminal device direction, and the identifying module is further configured to:

[0138] According to the second gaze point direction, correct the first gaze point direction to obtain a corrected gaze point direction;

[0139] Calculate a second direction included angle between the corrected gaze point direction and a terminal device direction of each preselected terminal device;

[0140] According to each second direction included angle, select a target device from the preselected terminal devices.

[0141] Optionally, the control module is further configured to:

[0142] push a connection prompt information to the wearing user, wherein the connection prompt information is used to prompt the user to select whether to connect the target device;

[0143] control the AR device to connect the target device according to the confirmation connection information fed back by the wearing user.

[0144] Optionally, the control module is further configured to:

[0145] receive the device function information sent by the target device, and display the device function information;

[0146] send a corresponding control instruction to the target device according to the feedback information of the wearing user on the device function information.

[0147] Optionally, the AR device includes an antenna array, the antenna array includes a first array element and a second array element, the terminal device includes a Bluetooth device, and the position information includes a Bluetooth device direction angle. The identification module is further configured to:

[0148] obtain a signal wavelength corresponding to a Bluetooth signal emitted by the Bluetooth device, a relative distance between the first array element and the second array element, and a phase difference generated when the Bluetooth signal reaches the first array element and the second array element;

[0149] calculate a Bluetooth device direction angle corresponding to the Bluetooth device according to the signal wavelength, the relative distance, and the phase difference.

[0150] The device control apparatus provided in the application adopts the device control method in the above embodiments, and solves the technical problem of low connection convenience of the intelligent terminal device. Compared with the prior art, the device control apparatus provided in the embodiments of the application has the same beneficial effects as the device control method provided in the above embodiments, and other technical features in the device control apparatus are the same as the features disclosed in the above embodiments, which will not be repeated here.

[0151] Embodiment Four

[0152] The electronic device provided in the embodiments of the application can be a headset or a terminal device carrying a headset, and the electronic device includes at least one processor and a memory in communication connection with the at least one processor. The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the device control method in the above embodiment one.

[0153] The following will be described with reference toFigure 4 FIG. 1 shows a structural diagram of an electronic device suitable for implementing embodiments of the present disclosure. The electronic device in embodiments of the present disclosure can include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (Personal Digital Assistant), a PAD (Tablet PC), a PMP (Portable Multimedia Player), a car terminal (e.g., a car navigation terminal), and the like, as well as a stationary terminal such as a digital TV, a desktop computer, and the like. Figure 4 The electronic device shown is merely an example and should not impose any limitation on the functions and use range of embodiments of the present disclosure.

[0154] As shown in FIG. 1, the electronic device can include a processing device (e.g., a central processing unit, a graphic processing unit, etc.) that can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) or a program loaded into a random access memory (RAM) from a storage device. In the RAM, various programs and data required for the operation of the electronic device are also stored. The processing device, the ROM, and the RAM are connected to each other through a bus. An input / output (I / O) interface is also connected to the bus. Figure 4

[0155] Generally, the following systems can be connected to the I / O interface: input devices including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, and the like; output devices including, for example, a liquid crystal display (LCD), a speaker, a vibrator, and the like; storage devices including, for example, a magnetic tape, a hard disk, and the like; and communication devices. The communication devices can allow the electronic device to communicate wirelessly or wiredly with other devices to exchange data. Although the electronic device having various systems is shown in the drawing, it should be understood that all of the systems shown are not required to be implemented or possessed. More or less systems can be alternatively implemented or possessed.

[0156] In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts can be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product including a computer program carried on a computer readable medium, the computer program containing program codes for executing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network through the communication device, or installed from the storage device, or installed from the ROM. When the computer program is executed by the processing device, the above-described functions defined in the methods of embodiments of the present disclosure are performed.

[0157] ​The electronic device provided in the present application adopts the device control method in the above embodiments, and solves the technical problem of low connection simplicity of the intelligent terminal device. Compared with the prior art, the electronic device provided in the embodiments of the present application has the same beneficial effects as the device control method provided in the above embodiments, and other technical features in the electronic device are the same as the features disclosed in the above method embodiments, which will not be described herein.

[0158] It should be understood that parts of the present disclosure can be realized by hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0159] The above merely provides a specific implementation of the present application, but the protection scope of the present application is not limited thereto, and any person skilled in the art can easily think of changes or replacements within the technical range disclosed in the present application, which should be covered in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

[0160] Embodiment five

[0161] The present embodiment provides a computer readable storage medium having computer readable program instructions stored thereon, the computer readable program instructions being used to execute the device control method in the above embodiment one.

[0162] The computer readable storage medium provided in the embodiments of the present application may, for example, be a U disk, but is not limited to an electric, magnetic, optical, electromagnetic, infrared, or semiconductor system, system or device, or any combination thereof. More specific examples of the computer readable storage medium can include, but are not limited to: an electric connection with one or more conductive wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present embodiment, the computer readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, system or device. The program code contained on the computer readable storage medium can be transmitted by any suitable medium, including but not limited to: electric wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0163] The above computer readable storage medium can be contained in the electronic device; or can exist separately without being assembled into the electronic device.

[0164] The computer readable storage medium described above carries one or more programs, when the one or more programs are executed by the electronic device, cause the electronic device to: identify a target device according to a first gaze point direction of a wearing user of the AR device in a real space; and control the AR device to connect to the target device and send a control instruction to the target device.

[0165] Computer program code for carrying out operations of the present disclosure can be written in any one or more programming languages, including object oriented programming languages such as Java, Smalltalk, C++, as well as conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0166] The flow diagrams and the block diagrams in the drawings are illustrations of possible architectures, functions, and operations for systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flow diagrams or block diagrams can represent a module, a segment, or a portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or the blocks may

[0167] The modules involved in the embodiments of the present disclosure can be implemented in the manner of software or in the manner of hardware. Among them, the name of the module does not constitute a limitation on the unit itself in some cases.

[0168] The computer readable storage medium provided by the application stores computer readable program instructions for executing the device control method, and solves the technical problem of low connection simplicity of the intelligent terminal device. Compared with the prior art, the computer readable storage medium provided by the embodiment of the application has the same beneficial effects as the device control method provided by the above-mentioned embodiment, and will not be described here.

[0169] Embodiment six

[0170] The application further provides a computer program product, comprising a computer program, which, when executed by a processor, implements the steps of the device control method as described above.

[0171] The computer program product provided by the application solves the technical problem of low connection simplicity of the intelligent terminal device. Compared with the prior art, the computer program product provided by the embodiment of the application has the same beneficial effects as the device control method provided by the above-mentioned embodiment, and will not be described here.

[0172] The above is only the preferred embodiment of the application, and does not limit the patent scope of the application, and any equivalent structure or equivalent flow transformation using the content of the specification and drawings, or direct or indirect application in other related technical fields, are also included in the patent processing scope of the application.

Claims

1. A device control method characterized by, The device control method applied to an AR device comprises: obtaining position information of a terminal device and a first gaze point direction of a user wearing the AR device in a real space, wherein the position information comprises a terminal device direction; calculating an included angle between each terminal device direction and the first gaze point direction to obtain a first direction included angle; selecting a terminal device corresponding to the first direction included angle within a preset included angle range as a preselected terminal device; if the number of preselected terminal devices is not multiple, identifying the preselected terminal device as a target device; if the number of preselected terminal devices is multiple, locally magnifying an AR display screen in the first gaze point direction, and determining a second gaze point direction of the user wearing the AR device in the real space; identifying a target device from the preselected terminal devices according to the second gaze point direction; controlling the AR device to connect to the target device and send a control instruction to the target device.

2. The device control method of claim 1, wherein, The position information comprises a terminal device direction, and the step of identifying a target device from the preselected terminal devices according to the second gaze point direction comprises: correcting the first gaze point direction according to the second gaze point direction to obtain a corrected gaze point direction; calculating a second direction included angle between the corrected gaze point direction and a terminal device direction of each preselected terminal device; selecting a target device from the preselected terminal devices according to the second direction included angle.

3. The device control method of claim 1, wherein, The step of controlling the AR device to connect to the target device comprises: pushing a connection prompt information to the user, wherein the connection prompt information is used to prompt the user to select whether to connect to the target device; controlling the AR device to connect to the target device according to confirmation connection information fed back by the user.

4. The device control method of claim 1, wherein, The step of sending a control instruction to the target device comprises: receiving device function information sent by the target device and displaying the device function information; sending a corresponding control instruction to the target device according to feedback information of the user on the device function information.

5. The device control method of claim 1, wherein, The AR device comprises an antenna array, the antenna array comprises a first array element and a second array element, the terminal device comprises a Bluetooth device, the position information comprises a Bluetooth device direction angle, The step of obtaining position information of a terminal device comprises: obtaining a signal wavelength corresponding to a Bluetooth signal emitted by the Bluetooth device, a relative distance between the first array element and the second array element, and a phase difference generated when the Bluetooth signal reaches the first array element and the second array element; calculating a Bluetooth device direction angle corresponding to the Bluetooth device according to the signal wavelength, the relative distance, and the phase difference.

6. An electronic device, comprising: The electronic device comprises: at least one processor; and a memory connected to the at least one processor in communication; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the steps of the device control method in any one of claims 1 to 5.

7. A computer readable storage medium characterized in that, The computer readable storage medium stores a program for implementing a device control method, and the program is executed by a processor to implement the steps of the device control method according to any one of claims 1 to 5.

Images