Remote control method and device, electronic equipment and medium

Abstract

The present disclosure relates to a remote control method and device, electronic equipment and medium, which are applied to electronic equipment provided with a remote control transmitter and a camera device, an image including a controlled device is acquired based on the camera device, a signal coverage range of the remote control transmitter is determined based on a field of view range of the remote control transmitter, a first image is displayed on a screen, and a first mark representing the signal coverage range is displayed on the first image. The remote control method of the present disclosure visualizes the signal coverage range through the first image and the first mark, so that the user can clearly know the range covered by the remote control signal, thereby improving the accuracy of remote control pointing when the electronic equipment is used as a remote control device, improving the accuracy of remote control signal emission, and improving the user experience.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of electronic devices, and particularly relates to a remote control method and device, an electronic device and a medium. BACKGROUND

[0002] With the progress of science and technology, the types and quantities of electrical equipment in the home and office environment are increasing, and each electrical equipment is usually equipped with a remote controller. Since the remote controllers of different electrical equipment are usually not universal, once the remote controller of an electrical equipment is damaged or lost, the electrical equipment may not be able to continue to be used through remote control, which causes inconvenience to the user. Moreover, when the number of remote controllers in the home or office environment is large, various remote controllers are mixed together, and the user cannot quickly find the remote controller to be used, which affects the user experience.

[0003] In order to avoid the user having to find the remote controller every time, and to avoid the remote controller being damaged or lost and not being able to remotely control the electrical equipment in time, a use mode of taking the mobile terminal as a universal remote controller has emerged. SUMMARY

[0004] In order to overcome the problems in the related art, the present disclosure provides a remote control method and device, an electronic device and a medium.

[0005] According to a first aspect of some example embodiments of the present disclosure, a remote control method is provided, applied to an electronic device provided with a remote control transmitter and a camera device, and the remote control method comprises:

[0006] obtaining a first image, the first image comprising at least an image of a controlled device, the first image being obtained based on the camera device;

[0007] obtaining a signal coverage range of the remote control transmitter, the signal coverage range being determined based on a field of view range of the remote control transmitter, and the signal coverage range and the first image having an overlapping area;

[0008] displaying the first image and displaying a first mark on the first image, the first mark being used to represent the signal coverage range.

[0009] In some example embodiments of the present disclosure, the remote control transmitter is arranged on a side of the electronic device opposite to the display screen, and the obtaining of the signal coverage range of the remote control transmitter comprises:

[0010] obtaining a field of view range of the remote control transmitter;

[0011] obtaining first attitude information of the electronic device relative to a preset plane;

[0012] Determine, based on the field of view range of the remote control transmitter and the first attitude information, a projection range of a view angle range of the remote control transmitter in the first image as the signal coverage range.

[0013] In some example embodiments of the present disclosure, the remote control transmitter is integrated in a camera device, and the remote control method comprises:

[0014] Starting the camera device based on a first instruction for starting a remote control application.

[0015] In some example embodiments of the present disclosure, the remote control method further comprises:

[0016] Based on the first instruction, issuing first indication information for indicating to direct the camera device towards the controlled device.

[0017] In some example embodiments of the present disclosure, the remote control method comprises:

[0018] Based on a second instruction acting on the remote control application, storing second attitude information of the electronic device;

[0019] In a first preset time period since the second instruction is received, obtaining third attitude information of the electronic device;

[0020] If the third attitude information changes by an angle greater than or equal to a first preset threshold value in at least one direction relative to the second attitude information, closing the camera device.

[0021] In some example embodiments of the present disclosure, the remote control method further comprises:

[0022] The electronic device maintains the attitude represented by the second attitude information for a second preset time period, and closes the camera device.

[0023] In some example embodiments of the present disclosure, the remote control method further comprises:

[0024] Since the camera device is closed, obtaining fourth attitude information of the electronic device;

[0025] If the fourth attitude information changes by an angle less than or equal to a second preset threshold value in any direction relative to the second attitude information, the camera device is turned on.

[0026] In some example embodiments of the present disclosure, the camera device comprises a plurality of camera heads, and the remote control method further comprises:

[0027] acquire a plurality of second images, the plurality of second images being acquired by at least two of the cameras respectively, the second images corresponding to the cameras one by one;

[0028] determine a first distance between the electronic device and the controlled device based on the plurality of second images;

[0029] determine a first transmission power of the remote control transmitter based on the first distance;

[0030] control the remote control transmitter to transmit a remote control signal based on the first transmission power.

[0031] In some example embodiments of the present disclosure, the remote control method further comprises:

[0032] The first transmission power is positively correlated with the first distance.

[0033] In some example embodiments of the present disclosure, the determining the first transmission power of the remote control transmitter based on the first distance comprises:

[0034] determining the first transmission power corresponding to the first distance based on pre-stored configuration information and the first distance, wherein the configuration information is used to represent the corresponding relationship between the distance between the electronic device and the controlled device and the transmission power.

[0035] According to a second aspect of the embodiments of the present disclosure, a remote control device is provided, applied to an electronic device provided with a remote control transmitter and a camera device, the remote control device comprising:

[0036] an acquisition module, configured to acquire a first image, the first image comprising at least an image of a controlled device, the first image being obtained based on the camera device;

[0037] The acquisition module is further configured to acquire a signal coverage range of the remote control transmitter, the signal coverage range being determined based on a field of view range of the remote control transmitter, and the signal coverage range and the first image having an overlapping area;

[0038] a control module, configured to display the first image and display a first mark on the first image, the first mark being used to represent the signal coverage range.

[0039] According to a third aspect of the embodiments of the present disclosure, an electronic device is provided, comprising:

[0040] a remote control transmitter;

[0041] a camera device;

[0042] a processor;

[0043] a memory for storing processor-executable instructions;

[0044] The processor is configured to execute the executable instructions in the memory to implement the remote control method provided in the first aspect of the present disclosure.

[0045] According to a fourth aspect of the embodiments of the present disclosure, a non-transitory computer-readable storage medium is provided, which has stored executable instructions, and the executable instructions are executed by a processor to implement the remote control method provided in the first aspect of the present disclosure.

[0046] The above method of the present disclosure has the following beneficial effects: the first image including the controlled device is acquired based on the camera, the signal coverage range of the remote control transmitter is determined based on the field of view range of the remote control transmitter, the first image is displayed on the screen, and the first mark representing the signal coverage range is displayed on the first image, the signal coverage range is visualized through the first image and the first mark, the user can clearly know the signal coverage range, thereby improving the accuracy of remote control pointing when the electronic device is used as a remote control device, improving the accuracy of remote control signal transmission, and improving the user experience.

[0047] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF DRAWINGS

[0048] The accompanying drawings, which are incorporated into and form part of the specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0049] Figure 1 is a flowchart of a remote control method according to an exemplary embodiment.

[0050] Figure 2 is a schematic diagram of a display interface of an electronic device according to an exemplary embodiment.

[0051] Figure 3 is a flowchart of a remote control method according to an exemplary embodiment.

[0052] Figure 4a is a schematic diagram of the position of a remote control transmitter according to an exemplary embodiment.

[0053] Figure 4b is a schematic diagram of the position of a remote control transmitter according to an exemplary embodiment.

[0054] Figure 5 is a flowchart of a remote control method according to an exemplary embodiment.

[0055] Figure 6is a block diagram of a remote control device according to an exemplary embodiment.

[0056] Figure 7 is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0057] The exemplary embodiments will be described in detail herein with reference to the attached drawings. In the following description, the same numbers are used to indicate the same elements throughout the several views. The following exemplary embodiments are not representative of all embodiments consistent with the present disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0058] In the related art, the remote control transmitter in the electronic device is mostly arranged on the top of the electronic device. When the electronic device is used as a remote controller, the holding manner and the remote control manner of the electronic device are similar to those of using a traditional handheld remote controller. The scheme of arranging the remote control transmitter on the top of the electronic device needs to open a hole on the middle frame of the electronic device, which not only is more complex in process, but also increases the risk of electrostatic damage to the mainboard. In addition, since the signal range of the existing remote control transmitter is in an invisible state, the user cannot accurately know the range of the remote control transmitter when remotely controlling the controlled device, so the remote control accuracy is low.

[0059] The present disclosure provides a remote control method applied to an electronic device provided with a remote control transmitter and a camera device, obtains a first image including a controlled device based on the camera device, obtains a signal coverage range based on a field of view range of the remote control transmitter, displays the first image on a screen of the electronic device, and displays a first mark representing the signal coverage range on the first image. Since the first image and the first mark signal are displayed on the screen during the remote control operation of the user using the electronic device, the remote control signal coverage range is visualized, the user can determine whether the signal emitted by the remote control transmitter can effectively control the controlled device, the accuracy of the remote control direction is improved, and the user experience is improved.

[0060] The exemplary embodiments of the present disclosure provide a remote control method applied to an electronic device provided with a remote control transmitter and a camera device, which can be a smart phone, a tablet computer, a smart watch, or the like. As shown in Figure 1 The remote control method shown in the present disclosure includes:

[0061] S101, obtaining a first image, the first image at least including an image of a controlled device, the first image being obtained based on a camera device;

[0062] S102. Obtain the signal coverage range of the remote control transmitter. The signal coverage range is determined based on the field of view of the remote control transmitter. The signal coverage range overlaps with the first image.

[0063] S103. Display a first image and display a first mark on the first image, the first mark being used to characterize the signal coverage area.

[0064] In step S101, when the electronic device activates its remote control function to remotely control the controlled device, the electronic device uses a camera to acquire a first image. The first image includes all content within the field of view of the camera, meaning it includes not only the controlled device but also its surrounding environment. It is understood that the electronic device's camera typically has multiple cameras, such as portrait cameras, wide-angle cameras, and telephoto cameras. When different cameras are used for image acquisition, the range of the first image acquired by different cameras and different combinations of cameras will vary. When the camera device includes only one camera, it can use that camera to capture the first image; when the camera device includes two or more cameras, it can use all cameras to capture the first image, or only one camera can be used to capture the first image. When the remote control function is activated, the electronic device will selectively activate one or more of the multiple cameras to acquire the first image according to preset configuration information.

[0065] like Figure 2 As shown, the first image 1 includes not only the controlled device 3, but also the chair 4 and table 5 surrounding the controlled device 3. The larger the field of view of the camera device, the more content the first image contains. For example, if the camera device includes two cameras, a wide-angle camera and a telephoto camera, then the first image captured using the wide-angle camera will contain far more content than the first image captured using the telephoto camera.

[0066] Since the first image is used to show the orientation of the current electronic device and the position of the controlled device, as long as the first image can reflect the positional relationship between the electronic device and the controlled device, the number of cameras will not affect the accuracy of remote control. This disclosure does not limit the number of cameras in the camera device.

[0067] In addition, the camera device in this embodiment can be multiple camera components installed on the back cover of the electronic device; if the electronic device is a foldable screen phone and external displays are installed on opposite sides of the electronic device, the camera device can also be a front-facing camera.

[0068] In step S102, the signal coverage range of the remote control transmitter is determined based on its field of view, which in turn is determined by its performance. Better performance results in a larger field of view, meaning a wider signal coverage, allowing the user to remotely control the device without precisely aligning the electronic device with the controlled device. Conversely, weaker performance results in a smaller field of view and thus a smaller signal coverage, requiring the user to align the electronic device as closely as possible with the controlled device to achieve remote control.

[0069] This embodiment does not specifically limit the placement of the remote control transmitter, as long as it ensures that when the remote control transmitter transmits a remote control signal, the camera device can capture an image including the controlled device, and that the signal coverage area of ​​the remote control transmitter overlaps with that of the controlled device, so that the remote control signal transmitted through the remote control transmitter on the electronic device can control the controlled device. For example, the remote control transmitter can be placed on the back cover of the electronic device, on the decorative part of the camera device, or on the top of the electronic device near the back cover.

[0070] This embodiment does not specifically limit the type of remote control transmitter. For example, the remote control transmitter can be an infrared transmitter, so the remote control signal is infrared light; or, for example, the remote control transmitter can be a laser transmitter, so the remote control signal is laser.

[0071] In step S103, the electronic device displays a first image on the screen and a first mark on the first image. The range indicated by the first mark is the signal coverage area. The first mark can be an elliptical image composed of dashed lines, an elliptical image with a light-colored fill, or other shapes such as squares or triangles. The user can choose the display format of the first mark according to their personal visual habits. The size of the first mark changes as the electronic device moves. When the electronic device is at an angle relative to a vertical plane, the fixed viewing angle of the remote transmitter causes the projection of the remote transmitter's viewing angle onto the plane of the controlled device to change, resulting in different sizes and shapes of the first mark. Furthermore, the distance between the electronic device and the controlled device also affects the size of the first mark displayed on the screen.

[0072] like Figure 2 As shown, a first image 1 and a first mark 2 are displayed on the screen of the electronic device. The first image 1 indicates that the electronic device is currently facing the controlled device 3, and the first mark 2 indicates that the controlled device 3 is within the signal coverage area, indicating that the user can remotely control the controlled device without moving the electronic device.

[0073] In the present disclosure, the electronic device acquires a first image including the controlled device based on the camera, acquires a signal coverage range based on the field of view range of the remote control transmitter, and the user can determine the signal coverage range based on the first image and the first mark displayed on the screen, thereby improving the accuracy of remote control pointing and improving the user experience.

[0074] According to an example embodiment, the present embodiment is a further description of step S102 in the above-mentioned embodiment. Before describing the method in the present embodiment, the scenario and the structure of the electronic device involved in the present embodiment are first described.

[0075] In order to make the appearance of the electronic device simple, reduce the top opening, and reduce the complexity of the processing process, the remote control transmitter can be arranged on the side of the electronic device opposite to the display screen, that is, on the side of the back shell of the electronic device. For example, the remote control transmitter can be integrated on the decorative piece of the camera. The camera in the present embodiment refers to the rear camera arranged on the back shell. The remote control transmitter emits remote control signals through the decorative piece lens opening to reduce the middle frame opening, reduce the process complexity, and reduce the risk of static damage to the mainboard. In this way, when using the electronic device for remote control, the same holding method as the traditional handheld remote controller is not required, but the electronic device needs to be erected so that the remote control signals emitted by the remote control transmitter can be aligned with the controlled device to achieve remote control of the controlled device. Since the remote control signals are invisible, although the process complexity is reduced, the difficulty of remote control pointing is increased, which is not conducive to improving the accuracy of the electronic device pointing to the controlled device. In order to improve the accuracy of remote control, the remote control method in the present embodiment can be used to accurately determine the signal coverage range of the remote control transmitter and realize signal range visualization. The remote control method in the present embodiment includes:

[0076] S1021, acquiring the field of view range of the remote control transmitter;

[0077] S1022, acquiring first attitude information of the electronic device relative to a preset plane;

[0078] S1023, determining the projection range of the field of view range of the remote control transmitter in the first image as the signal coverage range based on the field of view range of the remote control transmitter and the first attitude information.

[0079] In step S1021, the remote control transmitter is arranged on the side of the electronic device opposite to the display screen, i.e., the remote control transmitter is arranged on the back of the electronic device, so that the user can use the remote control transmitter to remotely control the controlled device without changing the holding manner of the electronic device. The field of view range of the remote control transmitter determines the range that can be remotely controlled by the electronic device, and the electronic device can only remotely control the controlled device within the field of view range. The field of view range of the remote control transmitter is determined based on the performance of the remote control transmitter, for example, if the quality of the chip in the remote control transmitter is high and the transmission power is large, the field of view range of the remote control transmitter is wide; if the quality of the chip in the remote control transmitter is low and the transmission power is small, the field of view range of the remote control transmitter is limited. The field of view range of the remote control transmitter or the camera device is usually fixed, and whether the final signal coverage range of the remote control transmitter and the first image captured by the camera device are within the field of view range and the posture information of the electronic device is determined, that is, when the posture information of the electronic device is different, the content in the first image and the signal coverage range of the remote control transmitter are also different.

[0080] In step S1022, the preset plane is a reference standard for determining the posture information of the electronic device. The plane parallel to the ground can be used as the preset plane, and the plane perpendicular to the ground can be used as the preset plane. The information of the preset plane is usually pre-stored in the electronic device. The electronic device can detect the inclination angle, moving speed, direction, position, etc. of the electronic device relative to the preset plane through built-in detection devices such as acceleration sensor, gravity sensor, magnetic force sensor, gyroscope, etc. The master control chip of the electronic device can determine the posture information of the electronic device according to the above-mentioned detected parameters. For example, the electronic device can use the acceleration sensor to obtain the acceleration of the electronic device in x, y, z three directions (i.e., three-dimensional coordinate system in space) to detect the inclination and movement of the electronic device; and can use the magnetic force sensor to detect the magnetic field around the electronic device to determine the direction and position of the electronic device. The first posture information in this step refers to the continuously detected posture information during the period from starting the remote control application to receiving the remote control application. If the user changes the position or angle of the electronic device during this process, the first posture information changes, and if the user keeps the electronic device stable and does not move, the first posture information does not change.

[0081] In step S1023, the field of view range of the remote control transmitter determines the signal coverage range, the first attitude information reflects the direction of the remote control of the electronic device, and determines the picture content of the first image. Therefore, the electronic device determines the projection range of the field of view range of the remote control transmitter in the first image as the signal coverage range based on the field of view range of the remote control transmitter and the first attitude information. Generally, the controlled device is installed based on a vertical plane. Therefore, when the user aligns the electronic device to the controlled device, if the electronic device is deflected relative to the vertical plane and the horizontal plane, the projection of the field of view range of the remote control transmitter on the plane where the controlled device is located will be reduced. Therefore, it is necessary to determine the coverage range of the remote control signal again according to the attitude of the electronic device. In addition, since the field of view range of the remote control transmitter changes with the distance, the electronic device can also obtain the image depth information through the analysis of the first image, and calculate the signal coverage range combined with the depth information of the first image to obtain a more accurate signal coverage range.

[0082] In the embodiment, the signal coverage range of the remote control transmitter is determined according to the attitude information of the electronic device, the range of the electronic device that can be covered by the remote control signal can be determined more accurately, and the visual effect is combined to facilitate the user to adjust the remote control direction or the remote control posture, thereby effectively improving the reliability and accuracy of the remote control.

[0083] According to an exemplary embodiment, as shown in Figure 3 The remote control method in the embodiment includes:

[0084] S301, starting the camera based on the first instruction of starting the remote control application;

[0085] S302, issuing first instruction information based on the first instruction, the first instruction information being used to instruct the camera to be directed to the controlled device;

[0086] S303, obtaining a first image, the first image at least including an image of the controlled device, the first image being obtained based on the camera;

[0087] S304, obtaining the field of view range of the remote control transmitter;

[0088] S305, obtaining first attitude information of the electronic device relative to a preset plane;

[0089] S306, determining the projection range of the field of view range of the remote control transmitter in the first image as the signal coverage range based on the field of view range of the remote control transmitter and the first attitude information;

[0090] S307, displaying the first image and displaying a first mark on the first image, the first mark being used to represent the signal coverage range;

[0091] S308, store second attitude information of the electronic device based on the second instruction acting on the remote control application;

[0092] S309, obtain third attitude information of the electronic device in a first preset time length from the time when the second instruction is received;

[0093] S310, determine whether the third attitude information changes relative to the second attitude information in at least one direction by an angle greater than or equal to a first preset threshold value, if the third attitude information changes relative to the second attitude information in all directions by an angle less than the first preset threshold value, execute step S311; if the third attitude information changes relative to the second attitude information in at least one direction by an angle greater than or equal to the first preset threshold value, execute step S312;

[0094] S311, determine whether the electronic device maintains the attitude represented by the second attitude information for a time length greater than a second preset time length, if the electronic device maintains the attitude represented by the second attitude information for a time length greater than or equal to the second preset time length, execute step S312; if the electronic device maintains the attitude represented by the second attitude information for a time length less than the second preset time length, execute step S309;

[0095] S312, turn off the camera device;

[0096] S313, obtain fourth attitude information of the electronic device from the time when the camera device is turned off;

[0097] S314, if the fourth attitude information changes relative to the second attitude information in any direction by an angle less than or equal to a second preset threshold value, turn on the camera device.

[0098] Wherein, steps S303 and S307 are the same as the implementation manners of steps S101 and S103 in the above embodiment, and steps S304 to S306 are the same as the implementation manners of S1021 to S1023 in the above embodiment, which will not be repeated here.

[0099] In step S301, the first instruction is used to start the remote control application, and the first instruction can be a touch instruction, a voice instruction or a gesture instruction, etc. For example, the first instruction can be clicking the icon of the remote control application; the first instruction can also be a voice input of "turning on the remote control application"; the first instruction can also be a gesture input of sliding from the lower right corner to the upper left corner.

[0100] The electronic device starts the remote control application in response to the first instruction, and switches the display interface to the interface of the remote control application, as shown in Figure 2 The interface of the remote control application displays a first image, and direction keys indicating up, down, left and right, a back key, a confirm key, an increase volume key, a decrease volume key, etc. The remote control transmitter is integrated in the camera device, as shown inFigure 4b As shown, both the remote control transmitter 41 and the camera 42 in the camera device are located on the back of the electronic device 40, with the remote control transmitter 41 integrated into the camera device. To ensure that the user can know the direction of the electronic device, the camera device is activated simultaneously with the launch of the remote control application. The camera device captures the image content of the electronic device's current orientation and displays it on the interface of the remote control application.

[0101] It should be noted that the remote control transmitter can be placed anywhere on the side of the electronic device opposite to the display screen. However, to simplify the appearance of the electronic device, reduce manufacturing complexity, minimize openings in the frame, and reduce the risk of electrostatic damage to the motherboard, the remote control transmitter can be placed on the rear camera decoration of the electronic device, utilizing the existing opening to transmit the remote control signal. For example... Figure 4a As shown, the remote transmitter 41 can be positioned away from the camera 42 in the camera device.

[0102] In step S302, to improve the accuracy of pointing when using the electronic device for remote control, the electronic device issues a first instruction based on the first command, instructing the camera to face the controlled device so as to ensure that the camera can capture the controlled device and its surrounding environment. The first instruction can be presented in the form of text, sound, vibration, etc., to prompt the user to face the camera towards the controlled device and determine the approximate remote control range. For example, the first prompt message "Please move your phone towards the controlled device" can be displayed on the remote control application interface. Alternatively, the electronic device can emit a two-second sound or vibrate three times consecutively to prompt the user to face the camera towards the controlled device.

[0103] In step S308, the second instruction includes operations that act on any button on the remote control application; that is, when the electronic device receives the second instruction, it indicates that the user is using the electronic device to operate the controlled device. For example... Figure 2 As shown, the electronic device displays a remote control application interface. The second command can be clicking the volume up button 6, the back button 8, or the close button 9. Button 9 can be used to turn off the controlled device, but not to close the remote control application. When the electronic device receives a second command from the user acting on the remote control application, it stores the electronic device's second attitude information. This second attitude information reflects the orientation and position of the electronic device relative to the controlled device when using the electronic device for remote control. The method for obtaining the second attitude information is the same as that for obtaining the first attitude information, and will not be described again here.

[0104] In step S309, after the remote control using the electronic device, if the user does not exit the interface of the remote control application, i.e., the remote control application is still in the running state in the foreground, the third attitude information of the electronic device is acquired in a first preset time length from the time when the second instruction is received. The third attitude information reflects the attitude of the electronic device in the first preset time length. By comparing the third attitude information with the second attitude information, it can be determined whether the direction and position of the electronic device are changed in the first preset time length after the remote control. The acquisition manner of the third attitude information is the same as that of the first attitude information, which will not be described herein.

[0105] In step S310, the comparison of the third attitude information and the second attitude information is to determine whether the angle of change of the third attitude information relative to the second attitude information in at least one direction is greater than or equal to a first preset threshold. If the angle of change of the third attitude information relative to the second attitude information in all directions is less than the first preset threshold, it indicates that the direction, position, etc. of the electronic device relative to the preset plane have almost no change. Then, step S311 is executed to further determine whether the time length that the electronic device maintains the attitude represented by the second attitude information is greater than a second preset time length. If the time length that the electronic device maintains the attitude represented by the second attitude information is greater than or equal to the second preset time length, it indicates that the electronic device is not moved for a long time, but also is not used for remote control. Therefore, step S312 is executed to turn off the camera to reduce the waste of power consumption, and the first image is no longer displayed on the interface of the remote control application.

[0106] If the time length that the electronic device maintains the attitude represented by the second attitude information is less than the second preset time length, it indicates that the electronic device is not moved for a certain time, and the user is still likely to use the electronic device for remote control. Therefore, step S309 is returned to be executed.

[0107] The second preset time length is usually the default setting of the remote control application, can be set according to the content of the second instruction, and can also be set according to the remote control habit of the user. For example, the default value of the second preset time length is 5s. If the second instruction is a shutdown key in the remote control application, i.e., the user has remotely controlled the controlled device to be turned off, and then does not need to use the controlled device again. Therefore, the second preset time length can be changed to 3s. For another example, the default value of the second preset time length is 5s. The user is used to changing the volume of the controlled device according to the noise level of the surrounding environment, so the second preset time length can be increased to 7s.

[0108] If the angle of change of the third attitude information relative to the second attitude information in at least one direction is greater than or equal to the first preset threshold, it indicates that the direction, position, etc. of the electronic device relative to the preset plane has a large change, and the user can stop using the electronic device for remote control, and thus step S312 is executed to turn off the camera.

[0109] In step S313, if the electronic device has not exited the interface of the remote control application program, fourth attitude information of the electronic device relative to the preset plane is acquired at the moment when the camera is turned off, and the acquisition manner of the fourth attitude information is the same as that of the first attitude information, which will not be described herein again. In step S314, the fourth attitude information is compared with the second attitude information, and if the angle of change of the fourth attitude information relative to the second attitude information in any direction is less than or equal to the second preset threshold, it indicates that the current direction, position, etc. of the electronic device is close to the direction, position, etc. when the second instruction is received, and there is a case that the user uses the electronic device to remotely control the controlled device again, and thus the camera is turned on again to capture the first image, and the first mark is displayed on the first image to prompt the user to control the pointing direction. The second preset threshold can be the same as or different from the first preset threshold.

[0110] For example, a plane parallel to the ground is taken as the preset plane, the first preset threshold and the second preset threshold are both set to 10°, the second attitude information reflects that the electronic device is 90° relative to the preset plane, i.e. the electronic device is in a right angle relationship perpendicular to the ground, and the third attitude information reflects that the electronic device is 45° relative to the preset plane within the first preset time period, i.e. the electronic device is in an acute angle relationship with the ground, and the angle of change in the vertical direction is greater than the first preset threshold, and thus the camera is turned off. After the camera is turned off, the fourth attitude information of the electronic device is acquired, and the fourth attitude information reflects that the electronic device is 85° relative to the preset plane, which is less than the second preset threshold, and thus the camera is turned on again.

[0111] In the present disclosure, the attitude information of the electronic device at various moments is compared to determine whether the user still needs to remotely control the controlled device, when it is determined that the user no longer needs to remotely control the controlled device, the electronic device turns off the camera to reduce power consumption, and when it is determined that the user still needs to remotely control the controlled device, the electronic device keeps or turns on the camera again to generate and display the first image and the first mark, which serves as a prompt to the user, increases the accuracy of the remote control pointing direction, facilitates the user to use the electronic device to remotely control the controlled device, and improves the user experience.

[0112] In the prior art, since the distance between the controlled device and the electronic device cannot be known, the remote control transmitter always works at the maximum power for constant work, lacking adjustment function. For example, the maximum current of a mobile phone driving the remote control transmitter is 300mA, and the maximum distance of remote control is 15m. In the process of remote control, the remote control transmitter is always driven at 300mA, but in actual use, the mobile phone is rarely used for remote control beyond 5m. Driving the remote control transmitter at the maximum current will cause great waste of power consumption.

[0113] To solve the above problems, the present disclosure provides a remote control method, which determines the distance between the electronic device and the controlled device by using the image captured by the camera device, and dynamically adjusts the transmission power of the remote control transmitter.

[0114] According to an exemplary embodiment, as shown in Figure 5 The remote control method in the present embodiment comprises:

[0115] S501, obtaining a first image, the first image comprising at least an image of the controlled device, the first image being obtained based on the camera device;

[0116] S502, obtaining a signal coverage range of the remote control transmitter, the signal coverage range being determined based on the field of view range of the remote control transmitter, and the signal coverage range and the first image having an overlapping area;

[0117] S503, displaying the first image and displaying a first mark on the first image, the first mark being used to represent the signal coverage range;

[0118] S504, obtaining a plurality of second images, the plurality of second images being obtained by at least two cameras in the camera device respectively, and the second image corresponding to the camera one by one;

[0119] S505, determining a first distance between the electronic device and the controlled device based on the plurality of second images;

[0120] S506, determining a first transmission power of the remote control transmitter based on the first distance;

[0121] S507, controlling the remote control transmitter to transmit the remote control signal based on the first transmission power.

[0122] Among them, steps S501-S503 are the same as the embodiments in the above embodiment, and will not be repeated here.

[0123] It should be noted that the processes of steps S504-S506 for determining the first transmission power of the remote control transmitter are not in a fixed sequence with step S501. The electronic device can simultaneously acquire the first image and the second image through the camera, or can first acquire the first image, and then acquire the second image when the distance between the electronic device and the controlled device changes and the first transmission power of the remote control transmitter needs to be adjusted. The first image can also be determined based on multiple second images.

[0124] In step S504, the camera includes multiple cameras, for example, can include two cameras of a long-focus camera and a wide-angle camera, and can also include three cameras of a normal camera, a long-focus camera and a wide-angle camera. When the electronic device starts the remote control application based on the first instruction, multiple cameras in the camera are started, and multiple second images are acquired by using at least two cameras respectively, and each second image corresponds to each camera one by one.

[0125] In step S505, the electronic device calculates the first distance between the electronic device and the controlled device based on the multiple second images by using a binocular distance measurement algorithm. The binocular distance measurement algorithm is a method for calculating the distance of an object by simultaneously shooting the same scene by using two cameras and measuring the pixel difference of the object in the image in the field of view of the two cameras. When the controlled object appears in the two second images at the same time, the position of the controlled device in the two second images is offset (the offset is the parallax) due to the baseline distance between the two cameras. The distance difference of the corresponding pixel points of the controlled device in the two second images is obtained through the parallax, and the three-dimensional coordinates of the controlled device are calculated through the principle of triangulation by knowing the baseline distance and the angle of view of the two cameras. The first distance between the electronic device and the controlled device is further calculated based on the three-dimensional coordinates.

[0126] In step S506, the electronic device determines the first transmission power of the remote control transmitter based on the first distance, wherein the first transmission power is positively correlated with the first distance, that is, the farther the distance between the electronic device and the controlled device, the greater the transmission power required by the remote control transmission device to realize remote control of the controlled device.

[0127] In some embodiments, step S506 determines the first transmission power of the remote control transmitter based on the first distance, including:

[0128] determining the first transmission power corresponding to the first distance based on the pre-stored configuration information and the first distance; wherein the configuration information is used to represent the corresponding relationship between the distance between the electronic device and the controlled device and the transmission power.

[0129] The configuration information can be table information pre-stored in the electronic device. Before the electronic device is shipped, the corresponding relationship between the distance between the electronic device and the controlled device and the transmission power is determined through repeated experiments, and the corresponding relationship is summarized as a table as the configuration information pre-stored in the electronic device, so that after the first distance is obtained, the electronic device can determine the first transmission power corresponding to the first distance by table lookup of the configuration information. For example, the configuration information stores that the first distance of (0, 5m] corresponds to the first transmission power of 10mw, the first distance of (5, 10m] corresponds to the first transmission power of 15mw, and the first distance of (10, 15m] corresponds to the first transmission power of 20mw. When it is determined that the first distance is 6m, the first transmission power of the remote control transmitter can be determined as 15mw through the configuration information.

[0130] The configuration information can also be a calculation formula related to the distance and the transmission power. The calculation formula is pre-stored in the electronic device, and the electronic device obtains the first transmission power by calculation based on the first distance. The first transmission power obtained by calculation is more accurate than the first transmission power obtained by table lookup.

[0131] In step S507, the electronic device further calculates a corresponding driving current based on the first transmission power of the remote control transmitter, and drives the remote control transmitter with the driving current corresponding to the first transmission power to make the remote control transmitter emit a remote control signal. Since the first transmission power is determined based on the distance between the electronic device and the controlled device, the demand of the remote control transmitter for remote control can be met, and excessive power consumption can be avoided.

[0132] In the present disclosure, the electronic device determines the first distance between the electronic device and the controlled device based on the second image captured by the camera, and dynamically adjusts the first transmission power of the remote control transmitter based on the first distance, which can effectively reduce the power consumption of the remote control transmitter and improve the endurance of the electronic device.

[0133] The exemplary embodiments of the present disclosure provide a remote control device applied to an electronic device provided with a remote control transmitter and a camera. As shown in Figure 6 The block diagram of the remote control device shown in the present disclosure is shown.

[0134] The block diagram includes an acquisition module 61 and a control module 62. The acquisition module 61 is used to acquire a first image, the first image at least including an image of a controlled device, and the first image is obtained based on a camera. The acquisition module 61 is also used to acquire a signal coverage range of a remote control transmitter, the signal coverage range being determined based on a field of view range of the remote control transmitter, and the signal coverage range and the first image having an overlapping area. The control module 62 is used to display the first image and display a first mark on the first image, the first mark being used to represent the signal coverage range.

[0135] In an example embodiment of the present disclosure, the remote control transmitter is arranged on a side of the electronic device opposite to the display screen, and the acquisition module 61 is further configured to: acquire a field of view range of the remote control transmitter; acquire first attitude information of the electronic device relative to a preset plane; and determine, based on the field of view range of the remote control transmitter and the first attitude information, a projection range of a field of view range of the remote control transmitter in the first image as the signal coverage range.

[0136] In an example embodiment of the present disclosure, the remote control transmitter is integrated into the camera device, and the control module 62 is further configured to: based on the first instruction for starting the remote control application, start the camera device.

[0137] In an example embodiment of the present disclosure, the control module 62 is further configured to: based on the first instruction, send first indication information, the first indication information being used to instruct to direct the camera device towards the controlled device.

[0138] In an example embodiment of the present disclosure, the control module 62 is further configured to: based on a second instruction acting on the remote control application, store second attitude information of the electronic device; acquire third attitude information of the electronic device in a first preset time length from a time when the second instruction is received; and if an angle of change of the third attitude information relative to the second attitude information in at least one direction is greater than or equal to a first preset threshold, turn off the camera device.

[0139] In an example embodiment of the present disclosure, the control module 62 is further configured to: keep the electronic device in a posture represented by the second attitude information for a second preset time length, and turn off the camera device.

[0140] In an example embodiment of the present disclosure, the control module 62 is further configured to: acquire fourth attitude information of the electronic device from a time when the camera device is turned off; and if angles of change of the fourth attitude information relative to the second attitude information in any direction are all less than or equal to a second preset threshold, turn on the camera device.

[0141] In an example embodiment of the present disclosure, the camera device includes a plurality of camera heads, and the control module 62 is further configured to:

[0142] acquire a plurality of second images, the plurality of second images being respectively acquired by at least two camera heads in the camera device, and each second image corresponding to a camera head; determine, based on the plurality of second images, a first distance between the electronic device and the controlled device; determine, based on the first distance, a first transmission power of the remote control transmitter; and control the remote control transmitter to transmit the remote control signal based on the first transmission power.

[0143] In an example embodiment of the present disclosure, the first transmission power is positively correlated with the first distance.

[0144] In an exemplary embodiment of the present disclosure, the control module 62 is further configured to determine a first transmission power corresponding to the first distance based on pre-stored configuration information and the first distance, wherein the configuration information is used to represent a corresponding relationship between distances between the electronic device and the controlled device and transmission powers.

[0145] With regard to the remote control device in the above-described embodiments, the specific manner in which the various modules perform operations has been described in detail in the embodiments related to the method, and will not be elaborated here.

[0146] Figure 7 is a block diagram of an electronic device 700 according to an exemplary embodiment. The electronic device 700 can be, for example, a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, or the like.

[0147] Referring to Figure 7 , the electronic device 700 can include one or more of the following components: a processing component 702, a memory 704, a power supply component 706, a multimedia component 708, an audio component 710, an input / output (I / O) interface 712, a sensor component 714, and a communication component 716.

[0148] The processing component 702 usually controls overall operations of the electronic device 700, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 702 can include one or more processors 720 to execute instructions to complete all or part of steps of the methods described above. In addition, the processing component 702 can include one or more modules to facilitate the interaction between the processing component 702 and other components. For example, the processing component 702 can include a multimedia module to facilitate the interaction between the multimedia component 708 and the processing component 702.

[0149] The memory 704 is configured to store various types of data to support operations of the electronic device 700. Examples of these data include instructions for any application or method operating on the electronic device 700, contact data, phonebook data, messages, pictures, videos, and the like. The memory 704 can be implemented by any type of volatile or non-volatile storage devices or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.

[0150] The power component 706 provides power to the various components of the electronic device 700. The power component 706 can include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the electronic device 700.

[0151] The multimedia component 708 includes a screen providing an output interface between the electronic device 700 and a user. In some embodiments, the screen can include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes the touch panel, the screen can be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense a touch, a slide, and a gesture on the touch panel. The touch sensor can not only sense a boundary of a touching or a sliding action, but also detect duration and pressure related to the touching or sliding action. In some embodiments, the multimedia component 708 includes a front camera and / or a rear camera. When the electronic device 700 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each of the front camera and the rear camera can be a fixed optical lens system or have a focal length and optical zoom capability.

[0152] The audio component 710 is configured to output and / or input an audio signal. For example, the audio component 710 includes a microphone (MIC) configured to receive an external audio signal when the electronic device 700 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 704 or transmitted via the communication component 716. In some embodiments, the audio component 710 also includes a speaker for outputting an audio signal.

[0153] The I / O interface 712 provides an interface between the processing component 702 and peripheral interface modules, which can be a keypad, a click wheel, buttons, and the like. The buttons can include, but are not limited to, a home button, a volume button, a start button, and a lock button.

[0154] The sensor component 714 includes one or more sensors for providing status assessments for various aspects of the electronic device 700. For example, the sensor component 714 can detect an open / closed position of the electronic device 700, relative positioning of components, such as a display and keypad of the electronic device 700, a change in position of the electronic device 700 or a component of the electronic device 700, presence or absence of user contact with the electronic device 700, orientation or acceleration / deceleration / g-force and temperature of the electronic device 700. The sensor component 714 can include an optical sensor for detecting ambient light, a proximity sensor configured to detect proximity of an object, a motion sensor, a temperature sensor, a magnetic sensor, an acceleration sensor, a gyroscope sensor, a pressure sensor, or the like.

[0155] The communication component 716 is configured to facilitate wired or wireless communication between the electronic device 700 and other devices. The electronic device 700 can access a wireless network based on a corresponding communication standard, such as WiFi, 2G, or 3G, or a combination thereof. In an example embodiment, the communication component 716 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In an example embodiment, the communication component 716 further includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on Radio Frequency Identification (RFID) techniques, Infrared Data Association (IrDA) techniques, Ultra-WideBand (UWB) techniques, Bluetooth (BT) techniques, and other techniques.

[0156] In an example embodiment, the electronic device 700 can be implemented using one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic elements, to perform the above-described methods.

[0157] In an example embodiment, a non-transitory computer-readable storage medium including instructions, such as the memory 704 including instructions, is also provided, which can be executed by the processor 720 of the electronic device 700 to implement the above-described remote control method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disc, and an optical data storage device, etc.

[0158] A non-transitory computer readable storage medium, when instructions in the storage medium are executed by a processor of an electronic device, cause a processing device of the electronic device to perform a remote control method provided by an exemplary embodiment of the present disclosure.

[0159] Other embodiments of the application will be apparent to those skilled in the art from consideration of the specification and practice of the application disclosed herein. It is intended that the specification and examples be considered as exemplary only, with the true scope and spirit of the application being indicated by the following claims.

[0160] It is to be understood that the application is not limited to the precise construction herein described and as shown in the attached drawings, and that various modifications and changes can be made by those skilled in the art without departing from the scope of the application. The scope of the application is to be indicated by the appended claims, rather than the description and examples.

Claims

1. A remote control method characterized by, The remote control method is applied to an electronic device provided with a remote control transmitter and a camera device, and the remote control method comprises the following steps: obtaining a first image, the first image comprising at least an image of a controlled device, the first image being obtained based on the camera device; obtaining a signal coverage range of the remote control transmitter, the signal coverage range being determined based on a field of view range of the remote control transmitter, and the signal coverage range having an overlapping area with the first image; displaying the first image and displaying a first mark on the first image, the first mark being used to represent the signal coverage range; the step of obtaining the signal coverage range of the remote control transmitter comprises the following steps: obtaining the field of view range of the remote control transmitter; obtaining first attitude information of the electronic device relative to a preset plane; determining a projection range of the field of view range of the remote control transmitter in the first image as the signal coverage range based on the field of view range of the remote control transmitter and the first attitude information.

2. The remote control method according to claim 1, wherein, The remote control transmitter is arranged on a side of the electronic device opposite to a display screen.

3. The remote control method of claim 1, wherein, The remote control transmitter is integrated with the camera device, and the remote control method comprises the following steps: starting the camera device based on a first instruction of starting a remote control application.

4. The remote control method according to claim 3, wherein The remote control method further comprises the following steps: sending first instruction information based on the first instruction, the first instruction information being used to instruct to direct the camera device towards the controlled device.

5. The remote control method according to claim 3, wherein, The remote control method comprises the following steps: storing second attitude information of the electronic device based on a second instruction acting on the remote control application; obtaining third attitude information of the electronic device within a first preset time length from a time when the second instruction is received; if an angle of change of the third attitude information relative to the second attitude information in at least one direction is greater than or equal to a first preset threshold, closing the camera device.

6. The remote control method according to claim 5, wherein, The remote control method further comprises the following steps: the electronic device maintaining a posture represented by the second attitude information for a second preset time length, and closing the camera device.

7. The remote control method of claim 5, wherein, The remote control method further comprises the following steps: obtaining fourth attitude information of the electronic device from a time when the camera device is closed; if an angle of change of the fourth attitude information relative to the second attitude information in any direction is less than or equal to a second preset threshold, opening the camera device.

8. The remote control method according to any one of claims 1 to 7, characterized in that, The camera device comprises a plurality of camera heads, and the remote control method further comprises the following steps: obtaining a plurality of second images, the plurality of second images being obtained by at least two of the camera heads in the camera device respectively, and the second images corresponding to the camera heads one by one; determining a first distance between the electronic device and the controlled device based on the plurality of second images; determining a first transmission power of the remote control transmitter based on the first distance; controlling the remote control transmitter to transmit a remote control signal based on the first transmission power.

9. The remote control method of claim 8, wherein, The remote control method further comprises the following steps: the first transmission power is positively correlated with the first distance.

10. The remote control method of claim 8, wherein, The step of determining the first transmission power of the remote control transmitter based on the first distance comprises the following steps: Determine the first transmission power corresponding to the first distance based on pre-stored configuration information and the first distance, wherein the configuration information is used to represent the correspondence between the distance between the electronic device and the controlled device and the transmission power.

11. A remote control device, characterized in that The electronic device is applied to a remote control transmitter and a camera device, and the remote control device comprises: An acquisition module is configured to acquire a first image, wherein the first image comprises at least an image of a controlled device, and the first image is obtained based on the camera device; The acquisition module is further configured to acquire a signal coverage range of the remote control transmitter, wherein the signal coverage range is determined based on a field of view range of the remote control transmitter, and the signal coverage range has an overlapping area with the first image; A control module is configured to display the first image and display a first mark on the first image, wherein the first mark is used to represent the signal coverage range; The acquisition module is further configured to: Acquire a field of view range of the remote control transmitter; Acquire first attitude information of the electronic device relative to a preset plane; Determine a projection range of the field of view range of the remote control transmitter in the first image as the signal coverage range based on the field of view range of the remote control transmitter and the first attitude information.

12. An electronic device, comprising: The electronic device comprises: A remote control transmitter; A camera device; A processor; A memory for storing processor-executable instructions; The processor is configured to execute the executable instructions in the memory to implement the remote control method according to any one of claims 1 to 10.

13. A non-transitory computer-readable storage medium having stored thereon executable instructions that, as a result of being executed by a computer, are adapted to cause the computer to at least: The executable instructions are executed by the processor to implement the remote control method according to any one of claims 1 to 10.

Images