Remote control method and device, electronic equipment and medium

Abstract

The invention relates to a remote control method and device, electronic equipment and a medium, which are applied to the electronic equipment provided with a remote control transmitter and a camera device, an image comprising controlled equipment is acquired based on the camera device, a signal coverage range of the remote control transmitter is determined based on a view field range of the remote control transmitter, and a first image is displayed on a screen. And displaying a first mark representing the signal coverage on the first image. According to the remote control method disclosed by the invention, the signal coverage range is visualized through the first image and the first mark, and a user can define the coverage range of the remote control signal, so that the accuracy of remote control pointing when the electronic equipment is used as remote control equipment is improved, the accuracy of remote control signal emission is improved, and the use experience of the user is improved.

Description

Technical Field

[0001] The present disclosure relates to the technical field of electronic equipment, and in particular to a remote control method, device, electronic equipment and medium. Background Art

[0002] With the advancement of technology, the types and number of electrical appliances in homes and office environments are increasing. Usually, each electrical appliance is equipped with a remote control. Since the remote controls of different electrical appliances are usually not universal, once the remote control of an electrical appliance is damaged or lost, the electrical appliance may not be able to continue to be used by remote control, causing inconvenience to the user. In addition, when there are a large number of remote controls in a home or office environment, multiple remote controls are mixed together, making it difficult for users to quickly find the remote control they want to use, affecting the user experience.

[0003] In order to avoid the user having to look for the remote control every time, and to avoid the inability to remotely control the electrical equipment in time when the remote control is damaged or lost, the use of mobile terminals as universal remote controls has emerged. Summary of the invention

[0004] In order to overcome the problems existing in the related art, the present disclosure provides a remote control method, device, electronic device and medium.

[0005] According to a first aspect of an embodiment of the present disclosure, a remote control method is provided, which is applied to an electronic device provided with a remote control transmitter and a camera device, and the remote control method includes:

[0006] Acquire a first image, where the first image at least includes an image of a controlled device, and the first image is acquired based on the camera device;

[0007] Acquire a signal coverage range of the remote control transmitter, where the signal coverage range is determined based on a field of view of the remote control transmitter, and where there is an overlapped area between the signal coverage range and the first image;

[0008] The first image is displayed and a first mark is displayed on the first image, where the first mark is used to represent the signal coverage range.

[0009] In some exemplary embodiments of the present disclosure, the remote control transmitter is disposed on a side of the electronic device that is away from the display screen, and obtaining the signal coverage range of the remote control transmitter includes:

[0010] Obtaining the field of view of the remote control transmitter;

[0011] Acquiring first posture information of the electronic device relative to a preset plane;

[0012] Based on the field of view of the remote control transmitter and the first posture information, a projection range of the viewing angle of the remote control transmitter in the first image is determined as the signal coverage range.

[0013] In some exemplary embodiments of the present disclosure, the remote control transmitter is integrated into a camera device, and the remote control method includes:

[0014] Based on a first instruction to start a remote control application, the camera device is started.

[0015] In some exemplary embodiments of the present disclosure, the remote control method further includes:

[0016] Based on the first instruction, first instruction information is issued, where the first instruction information is used to instruct the camera to be directed toward a controlled device.

[0017] In some exemplary embodiments of the present disclosure, the remote control method includes:

[0018] storing second posture information of the electronic device based on a second instruction acting on the remote control application;

[0019] Acquire third posture information of the electronic device within a first preset time period from the moment when the second instruction is received;

[0020] If the angle at which the third posture information changes in at least one direction relative to the second posture information is greater than or equal to a first preset threshold, the camera device is turned off.

[0021] In some exemplary embodiments of the present disclosure, the remote control method further includes:

[0022] The electronic device maintains the posture represented by the second posture information for a second preset time period and turns off the camera.

[0023] In some exemplary embodiments of the present disclosure, the remote control method further includes:

[0024] From the moment when the camera device is turned off, acquiring fourth posture information of the electronic device;

[0025] If the angle at which the fourth posture information changes relative to the second posture information in any direction is less than or equal to a second preset threshold, the camera device is turned on.

[0026] In some exemplary embodiments of the present disclosure, the camera device includes a plurality of cameras, and the remote control method further includes:

[0027] Acquire a plurality of second images, where the plurality of second images are acquired respectively by at least two cameras in the camera device, and the second images correspond one to one with the cameras;

[0028] Determining a first distance between the electronic device and the controlled device based on the plurality of second images;

[0029] determining a first transmission power of the remote control transmitter based on the first distance;

[0030] Based on the first transmission power, the remote control transmitter is controlled to transmit a remote control signal.

[0031] In some exemplary embodiments of the present disclosure, the remote control method further includes:

[0032] The first transmission power is positively correlated with the first distance.

[0033] In some exemplary embodiments of the present disclosure, determining the first transmission power of the remote control transmitter based on the first distance includes:

[0034] Based on pre-stored configuration information and the first distance, the first transmission power corresponding to the first distance is determined; wherein the configuration information is used to characterize the correspondence between the distance between the electronic device and the controlled device and the transmission power.

[0035] According to a second aspect of an embodiment of the present disclosure, a remote control device is provided, which is applied to an electronic device provided with a remote control transmitter and a camera device, and the remote control device includes:

[0036] An acquisition module, configured to acquire a first image, wherein the first image at least includes an image of a controlled device, and the first image is acquired based on the camera device;

[0037] The acquisition module is further used to acquire a signal coverage range of the remote control transmitter, where the signal coverage range is determined based on a field of view range of the remote control transmitter, and where there is an overlapped area between the signal coverage range and the first image;

[0038] A control module is used to display the first image and display a first mark on the first image, where the first mark is used to represent the signal coverage range.

[0039] According to a third aspect of an embodiment of the present disclosure, an electronic device is provided, the electronic device comprising:

[0040] Remote control transmitter;

[0041] Camera device;

[0042] processor;

[0043] a memory for storing processor-executable instructions;

[0044] The processor is configured to execute executable instructions in the memory to implement the remote control method provided in the first aspect of the present disclosure.

[0045] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided, on which executable instructions are stored. When the executable instructions are executed by a processor, the remote control method provided by the first aspect of the present disclosure is implemented.

[0046] The above method of the present disclosure has the following beneficial effects: a first image including a controlled device is acquired based on a camera device, a signal coverage range of a remote control transmitter is determined based on the field of view of the remote control transmitter, the first image is displayed on a screen, and a first mark representing the signal coverage range is displayed on the first image, the signal coverage range is visualized through the first image and the first mark, and a user can clearly understand the signal coverage range, thereby improving the accuracy of remote control pointing when using the electronic device as a remote control device, improving the accuracy of remote control signal transmission, and improving the user experience.

[0047] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0049] Figure 1 The figure is a flowchart of a remote control method according to an exemplary embodiment.

[0050] Figure 2 It is a schematic diagram of a display interface of an electronic device according to an exemplary embodiment.

[0051] Figure 3 The figure is a flowchart of a remote control method according to an exemplary embodiment.

[0052] Figure 4a is a schematic diagram showing the position of a remote control transmitter according to an exemplary embodiment.

[0053] Figure 4b is a schematic diagram showing the position of a remote control transmitter according to an exemplary embodiment.

[0054] Figure 5 The figure is a flowchart of a remote control method according to an exemplary embodiment.

[0055] Figure 6is a block diagram of a remote control device according to an exemplary embodiment.

[0056] Figure 7 is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0057] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.

[0058] In the related art, the remote control transmitter in the electronic device is mostly set on the top of the electronic device. When the electronic device is used as a remote control, the way of holding and controlling the electronic device is similar to using a traditional handheld remote control for remote control. The solution of setting the remote control transmitter on the top of the electronic device requires opening a hole in the middle frame of the electronic device, which not only complicates the process but also increases the risk of electrostatic damage to the motherboard. In addition, since the signal range of the existing remote control transmitter is invisible, the user cannot accurately know the range of the remote control transmitter when remotely controlling the controlled device, so the remote control accuracy is low.

[0059] The present disclosure provides a remote control method, which is applied to an electronic device provided with a remote control transmitter and a camera device, wherein a first image including a controlled device is acquired based on the camera device, a signal coverage range is acquired based on the field of view range of the remote control transmitter, the first image is displayed on a screen of the electronic device, and a first mark representing the signal coverage range is displayed on the first image. Since the user can display the first image and the first mark signal on the screen during the process of using the electronic device for remote control operation, the remote control signal coverage range is visualized, and the user can clearly understand whether the signal sent by the remote control transmitter can effectively control the controlled device, thereby improving the accuracy of the remote control pointing and enhancing the user's experience.

[0060] The exemplary embodiment of the present disclosure provides a remote control method, which is applied to an electronic device provided with a remote control transmitter and a camera device, and specifically can be a smart electronic device such as a smart phone, a tablet computer, a smart watch, etc. Figure 1 As shown, the remote control method shown in the present disclosure includes:

[0061] S101, acquiring a first image, where the first image at least includes an image of a controlled device, and the first image is acquired based on a camera device;

[0062] S102, obtaining a signal coverage range of the remote control transmitter, where the signal coverage range is determined based on the field of view of the remote control transmitter, and the signal coverage range overlaps with the first image;

[0063] S103: Display a first image and display a first mark on the first image, where the first mark is used to represent a signal coverage range.

[0064] In step S101, when the electronic device turns on the remote control function to remotely control the controlled device, the electronic device uses the camera device to obtain a first image. The first image contains all the picture content within the field of view of the camera device, that is, the first image includes not only the controlled device, but also the surrounding environment of the controlled device. It can be understood that the camera device of the electronic device is usually provided with multiple cameras, such as a portrait camera, a wide-angle camera, a telephoto camera, etc. When different cameras are used to obtain images, the range of the first image obtained by different cameras and different camera combinations is different. When the camera device includes only one camera, one camera can be used to capture the first image; when the camera device includes two or more cameras, all cameras can be used to capture the first image, or only one of the cameras can be used to capture the first image. When the remote control function is turned on, the electronic device will selectively turn on one or more of the multiple cameras to obtain the first image according to the preset configuration information.

[0065] like Figure 2 As shown, the first image 1 includes not only the controlled device 3 but also the chairs 4 and the table 5 around the controlled device 3. The larger the field of view of the camera device, the more content is included in the captured first image. For example, if the camera device includes two cameras, a wide-angle camera and a telephoto camera, the image content of the first image captured by the wide-angle camera is much greater than that of the first image captured by the telephoto camera.

[0066] Since the first image is used to display the current orientation of the electronic device and the position of the controlled device, as long as the first image can reflect the positional relationship between the electronic device and the controlled device, the number of cameras will not affect the accuracy of the remote control, and the present disclosure does not limit the number of cameras in the camera device.

[0067] In addition, the camera device in this embodiment can be a plurality of camera assemblies arranged on the back shell of the electronic device; if the electronic device is a folding screen mobile phone, and external display screens are respectively arranged on two opposite sides of the electronic device, the camera device can also be a front camera.

[0068] In step S102, the signal coverage range of the remote control transmitter is determined based on the field of view of the remote control transmitter, and the field of view of the remote control transmitter is determined based on the performance of the remote control transmitter. The better the performance of the remote control transmitter, the larger its field of view, that is, the wider the signal coverage range, and the user can remotely control the controlled device without having to operate the electronic device to accurately align the controlled device. If the performance of the remote control transmitter is relatively weak, its field of view is small, and the signal coverage range is also small. The user needs to operate the electronic device to align the controlled device as much as possible before remotely controlling the controlled device.

[0069] This embodiment does not specifically limit the location of the remote control transmitter, as long as it is ensured that when the remote control transmitter is used to transmit the remote control signal, the camera device can capture an image containing the controlled device, and it is ensured that the signal coverage of the remote control transmitter can overlap with the controlled device, so that the remote control signal transmitted by the remote control transmitter on the electronic device can control the controlled device. For example, the remote control transmitter can be set on the back shell of the electronic device or on the decorative piece of the camera device, or at a position close to the back shell on the top of the electronic device.

[0070] This embodiment does not specifically limit the type of the remote control transmitter. The remote control transmitter may be, for example, an infrared transmitter, so that the remote control signal is infrared light. For another example, if the remote control transmitter is a laser transmitter, then the remote control signal is laser light.

[0071] In step S103, the electronic device displays a first image on the screen, and displays a first mark on the first image, and the range indicated by the first mark is the signal coverage range. Among them, the first mark can be an elliptical image composed of dotted lines, the first mark can also be an elliptical image with light color filling, and the first mark can also be other shape images, such as square, triangle, etc. The user can choose to set the display form of the first mark according to personal visual habits. The size of the first mark will change with the movement of the electronic device. When the electronic device is at an angle relative to the vertical plane, the viewing angle range of the remote control transmitter is fixed, so that the size of the projection of the viewing angle range of the remote control transmitter on the plane where the controlled device is located changes, resulting in different sizes and shapes of the first mark. In addition, the distance between the electronic device and the controlled device is different, which will also cause the size of the first mark displayed on the screen to be different.

[0072] like Figure 2 As shown, a first image 1 and a first mark 2 are displayed on the screen of the electronic device, wherein the first image 1 reflects that the electronic device is currently facing the controlled device 3, and the first mark 2 reflects that the controlled device 3 is within the signal coverage range, indicating that the user can remotely control the controlled device without moving the electronic device.

[0073] In the present disclosure, the electronic device obtains a first image including a controlled device based on a camera device, and obtains a signal coverage range based on the field of view of a remote control transmitter. The user can clearly understand the signal coverage range based on the first image and the first mark displayed on the screen, thereby improving the accuracy of remote control pointing and enhancing the user experience.

[0074] According to an exemplary embodiment, this embodiment is a further description of step S102 in the above embodiment. Before describing the method in this embodiment, the scenario of this embodiment and the structure of the electronic device involved are first described.

[0075] In order to make the appearance of the electronic device simple, reduce the top openings, and reduce the complexity of the processing technology, the remote control transmitter can be set on the side of the electronic device away from the display screen, that is, on the side where the back shell of the electronic device is located. For example, the remote control transmitter can be integrated into the decorative part of the camera device. The camera device in this embodiment refers to the rear camera set on the back shell, so that the remote control transmitter transmits the remote control signal through the opening of the decorative lens to reduce the opening of the middle frame, reduce the complexity of the process, and reduce the risk of electrostatic damage to the mainboard. In this way, when using the electronic device for remote control, there is no need to use the same holding method as the traditional handheld remote control, but the electronic device needs to be erected so that the remote control signal emitted by the remote control transmitter can be aimed at the controlled device to achieve remote control of the controlled device. Since the remote control signal is not visible, although the complexity of the process is reduced, the difficulty of remote control pointing is increased, which is not conducive to improving the accuracy of the electronic device pointing to the controlled device. In order to improve the accuracy of remote control, the remote control method in this embodiment can be used to accurately determine the signal coverage range of the remote control transmitter and realize the visualization of the signal range. The remote control method in this embodiment includes:

[0076] S1021. Obtain the field of view of the remote control transmitter;

[0077] S1022, obtaining first posture information of the electronic device relative to a preset plane;

[0078] S1023: Based on the field of view of the remote control transmitter and the first posture information, determine a projection range of the viewing angle of the remote control transmitter in the first image as a signal coverage range.

[0079] In step S1021, the remote control transmitter is arranged on the side of the electronic device away from the display screen, that is, the remote control transmitter is arranged on the back of the electronic device, and the user can use the remote control transmitter to remotely control the controlled device without changing the way of holding the electronic device. The field of view of the remote control transmitter determines the range within which the electronic device can be remotely controlled, and the electronic device can only remotely control the controlled devices within the field of view. The field of view of the remote control transmitter is determined based on the performance of the remote control transmitter. For example, if the chip quality in the remote control transmitter is high and the transmission power is large, the field of view of the remote control transmitter is wide; if the chip quality in the remote control transmitter is low and the transmission power is small, the field of view of the remote control transmitter is limited. The field of view of the remote control transmitter or the camera device is usually fixed. The final signal coverage of the remote control transmitter and the first image captured by the camera device are determined by the field of view and the posture information of the electronic device. That is to say, when the posture information of the electronic device is different, the content in the first image and the signal coverage of the remote control transmitter are also different.

[0080] In step S1022, the preset plane is a reference standard for judging the posture information of the electronic device. A plane parallel to the ground can be used as a preset plane, and a plane perpendicular to the ground can be used as a preset plane. The information of the preset plane is usually pre-stored in the electronic device. The electronic device can detect the inclination angle, moving speed, direction, position, etc. of the electronic device relative to the preset plane through built-in detection devices such as acceleration sensors, gravity sensors, magnetic sensors, gyroscopes, etc. The main control chip of the electronic device can determine the posture information of the electronic device based on the above-mentioned detected parameters. For example, the electronic device can use an acceleration sensor to obtain the acceleration of the electronic device in the three directions of x, y, and z (i.e., a three-dimensional coordinate system in space) to detect the inclination and movement of the electronic device; the magnetic sensor can be used to detect the magnetic field around the electronic device to determine the direction and position of the electronic device. The first posture information in this step refers to the posture information continuously detected during the period when the remote control application is started but has not yet been received to act on the remote control application. In this process, if the user changes the position or angle of the electronic device, the first posture information changes. If the user keeps the electronic device stable, the first posture information remains unchanged.

[0081] In step S1023, the field of view of the remote control transmitter determines the signal coverage range, and the first posture information reflects the direction of the electronic device remote control and determines the screen content of the first image. Therefore, the electronic device determines the projection range of the viewing angle range of the remote control transmitter in the first image based on the field of view of the remote control transmitter and the first posture information, and the projection range is the signal coverage range. Generally, the controlled device is installed based on the vertical plane, so when the user aims the electronic device at the controlled device, if the electronic device is deflected relative to the vertical plane and the horizontal plane, the projection of the field of view of the remote control transmitter on the plane where the controlled device is located will be reduced, so it is necessary to redetermine the coverage range of the remote control signal according to the posture of the electronic device. In addition, since the field of view of the remote control transmitter changes with the distance, the electronic device can also obtain the image depth information by analyzing the first image, and calculate the signal coverage range in combination with the depth information of the first image to obtain a more accurate signal coverage range.

[0082] In this embodiment, the signal coverage range of the remote control transmitter is determined based on the posture information of the electronic device, which can more accurately determine the range of the electronic device that the remote control signal can cover. Combined with the visualization effect, it is convenient for the user to adjust the remote control direction or remote control posture, thereby effectively improving the reliability and accuracy of the remote control.

[0083] According to an exemplary embodiment, Figure 3 As shown, the remote control method in this embodiment includes:

[0084] S301, starting a camera device based on a first instruction to start a remote control application program;

[0085] S302: Based on the first instruction, issue first instruction information, where the first instruction information is used to instruct to point the camera device toward the controlled device;

[0086] S303, acquiring a first image, where the first image at least includes an image of the controlled device, and the first image is acquired based on a camera device;

[0087] S304, obtaining the field of view of the remote control transmitter;

[0088] S305, obtaining first posture information of the electronic device relative to a preset plane;

[0089] S306, based on the field of view of the remote control transmitter and the first posture information, determining a projection range of the viewing angle of the remote control transmitter in the first image as a signal coverage range;

[0090] S307, displaying the first image and displaying a first mark on the first image, where the first mark is used to represent the signal coverage range;

[0091] S308, storing second posture information of the electronic device based on the second instruction acting on the remote control application;

[0092] S309, acquiring third posture information of the electronic device within a first preset time period from the moment when the second instruction is received;

[0093] S310, determining whether the angle of change of the third posture information relative to the second posture information in at least one direction is greater than or equal to a first preset threshold value, if the angle of change of the third posture information relative to the second posture information in all directions is less than the first preset threshold value, executing step S311; if the angle of change of the third posture information relative to the second posture information in at least one direction is greater than or equal to the first preset threshold value, executing step S312;

[0094] S311, determining whether the duration for which the electronic device maintains the posture represented by the second posture information is greater than a second preset duration, if the duration for which the electronic device maintains the posture represented by the second posture information is greater than or equal to the second preset duration, executing step S312; if the duration for which the electronic device maintains the posture represented by the second posture information is less than the second preset duration, executing step S309;

[0095] S312, turning off the camera device;

[0096] S313, acquiring fourth posture information of the electronic device from the moment the camera device is turned off;

[0097] S314: If the angle of change of the fourth posture information relative to the second posture information in any direction is less than or equal to the second preset threshold, turn on the camera device.

[0098] Among them, steps S303 and S307 are implemented in the same way as steps S101 and S103 in the above embodiment, and steps S304 to S306 are implemented in the same way as S1021 to S1023 in the above embodiment, which will not be repeated here.

[0099] In step S301, the first instruction is used to start the remote control application. The first instruction can be a touch instruction, a voice instruction or a gesture instruction, etc. For example, the first instruction can be clicking on the icon of the remote control application; the first instruction can also be a voice input of "open the remote control application"; the first instruction can also be a gesture input of sliding from the lower right corner to the upper left corner.

[0100] The electronic device responds to the first instruction, starts the remote control application, and switches the display interface to the interface of the remote control application, such as Figure 2 As shown, the interface of the remote control application displays a first image, as well as up, down, left, and right direction keys, a return key, an OK key, a volume increase key, a volume decrease key, etc. The remote control transmitter is integrated in the camera device, such as Figure 4b As shown, the remote control transmitter 41 and the camera 42 in the camera device are both arranged on the back of the electronic device 40, and the remote control transmitter 41 is integrated into the camera device. In order to ensure that the user can know the direction of the electronic device, the electronic device starts the camera device at the same time as the remote control application is started, and the camera device takes a picture of the screen content currently pointed at by the electronic device and displays it on the interface of the remote control application.

[0101] It should be noted that the remote control transmitter can be set at any position on the side of the electronic device away from the display screen. However, in order to make the appearance of the electronic device simple, reduce the complexity of the process, reduce the number of openings in the middle frame, and reduce the risk of electrostatic damage to the mainboard, the remote control transmitter can be set on the rear camera decoration of the electronic device and use the original opening to transmit the remote control signal. Figure 4a As shown, the remote control transmitter 41 can be set at a position far away from the camera 42 in the camera device.

[0102] In step S302, in order to improve the accuracy of pointing when using an electronic device for remote control, the electronic device issues a first instruction based on the first instruction, instructing the camera to be directed toward the controlled device to ensure that the camera can capture the controlled device and the surrounding environment of the controlled device. The first instruction information can be presented in the form of text, sound, vibration, etc. to prompt the user to point the camera toward the controlled device and determine the approximate remote control range. For example, the first prompt message "Please move the phone toward the controlled device" can be displayed on the interface of the remote control application, and the electronic device can also emit a two-second prompt sound or the electronic device can vibrate three times in a row to prompt the user to point the camera toward the controlled device.

[0103] In step S308, the second instruction includes an operation on any key on the remote control application, that is, when the electronic device receives the second instruction, it indicates that the user is using the electronic device to operate the controlled device. Figure 2 As shown, the electronic device displays the remote control application interface, the second instruction can be clicking the volume increase button 6, the second instruction can also be clicking the return button 8, the second instruction can also be clicking the close button 9, button 9 can be used to close the controlled device, but is not used to close the remote control application. When the electronic device receives the second instruction of the user acting on the remote control application, the second posture information of the electronic device is stored, and the second posture information can reflect the direction and position relative to the controlled device when the electronic device is used for remote control. Among them, the method for obtaining the second posture information is the same as the method for obtaining the first posture information, which will not be repeated here.

[0104] In step S309, after using the electronic device for remote control, if the user does not exit the interface of the remote control application, that is, the remote control application is still in the foreground and running, then the third posture information of the electronic device is obtained in the first preset time period from the moment of receiving the second instruction. The third posture information reflects the posture of the electronic device in the first preset time period. By comparing the third posture information with the second posture information, it can be determined whether the direction and position of the electronic device are changed in the first preset time period after the remote control. The method for obtaining the third posture information is the same as the method for obtaining the first posture information in the previous text, and it will not be repeated here.

[0105] In step S310, the third posture information is compared with the second posture information to determine whether the angle of change of the third posture information relative to the second posture information in at least one direction is greater than or equal to a first preset threshold value. If the angle of change of the third posture information relative to the second posture information in all directions is less than the first preset threshold value, it means that the direction, position, etc. of the electronic device relative to the preset plane have hardly changed, and step S311 is executed to further determine whether the duration for which the electronic device maintains the posture represented by the second posture information is greater than the second preset duration. If the duration for which the electronic device maintains the posture represented by the second posture information is greater than or equal to the second preset duration, it means that although the electronic device has not been moved for a long time, the electronic device has not been used for remote control. Therefore, step S312 is executed to turn off the camera device to reduce power consumption, and the first image is no longer displayed on the interface of the remote control application.

[0106] If the duration for which the electronic device maintains the posture represented by the second posture information is less than the second preset duration, it means that the electronic device has not been moved within a certain period of time, and the user may still use the electronic device for remote control next, so the process returns to step S309.

[0107] The second preset duration is usually the default setting of the remote control application, and can also be set according to the content of the second instruction, or according to the user's personal remote control habits. For example, the default value of the second preset duration is 5s. If the second instruction acts on the close button in the remote control application, that is, the user has remotely turned off the controlled device and does not need to use the controlled device anymore, the second preset duration can be changed to 3s. For another example, the default value of the second preset duration is 5s, and the user is accustomed to changing the volume of the controlled device according to the noise level of the surrounding environment, so the second preset duration can be increased and set to 7s.

[0108] If the angle at which the third posture information changes in at least one direction relative to the second posture information is greater than or equal to the first preset threshold, it means that the direction, position, etc. of the electronic device relative to the preset plane has changed significantly, and the user may stop using the electronic device for remote control. Therefore, step S312 is executed to turn off the camera device.

[0109] In step S313, if the electronic device has not exited the interface of the remote control application, the fourth posture information of the electronic device relative to the preset plane is obtained from the moment the camera device is turned off. The fourth posture information is obtained in the same way as the first posture information, which will not be repeated. Step S314 compares the fourth posture information with the second posture information. If the angle of change of the fourth posture information in any direction relative to the second posture information is less than or equal to the second preset threshold, it means that the current direction and position of the electronic device are close to the direction and position when the second instruction is received, and there is a situation where the user uses the electronic device to remotely control the controlled device again. Therefore, the camera device is turned on again to capture the first image, and the first mark is displayed on the first image to prompt the user of the remote control direction. Among them, the second preset threshold and the first preset threshold can be the same or different.

[0110] For example, a plane parallel to the ground is used as a preset plane, the first preset threshold and the second preset threshold are both set to 10°, the second posture information reflects that the electronic device is 90° relative to the preset plane, that is, the electronic device is perpendicular to the ground at a right angle, and within the first preset time, the received third posture information reflects that the electronic device is 45° relative to the preset plane, that is, the electronic device is at an acute angle to the ground, and the change angle in the vertical direction is greater than the first preset threshold, so the camera device is turned off. After the camera device is turned off, the fourth posture information of the electronic device is obtained, and the fourth posture information reflects that the electronic device is 85° relative to the preset plane, which is less than the second preset threshold, so the camera device is turned on again.

[0111] In the present disclosure, the posture information of the electronic device at various moments is compared to determine whether the user still needs to remotely control the controlled device. When it is determined that the user no longer needs to remotely control the controlled device, the electronic device turns off the camera to reduce power consumption; when it is determined that the user still needs to remotely control the controlled device, the electronic device keeps the camera turned on or reopens the camera, generates and displays a first image and a first mark, which serves as a prompt to the user, increases the accuracy of the remote control pointing, facilitates the user to use the electronic device to remotely control the controlled device, and improves the user's experience.

[0112] In the prior art, since it is impossible to know the distance between the controlled device and the electronic device, when the electronic device is remotely controlled, the remote control transmitter always uses the maximum power to operate constantly, and lacks the adjustment function. For example, the maximum current of a mobile phone driving the remote control transmitter is 300mA, and the farthest distance that can be remotely controlled is 15m. During the remote control process, the remote control transmitter is always driven by 300mA, but in actual use, the mobile phone is rarely used to control the distance exceeding 5m. Driving the remote control transmitter with the maximum current will cause a great waste of power consumption.

[0113] In order to solve the above problems, the present disclosure proposes a remote control method, which uses an image captured by a camera device to determine the distance between an electronic device and a controlled device, and dynamically adjusts the transmission power of a remote control transmitter.

[0114] According to an exemplary embodiment, Figure 5 As shown, the remote control method in this embodiment includes:

[0115] S501, acquiring a first image, where the first image at least includes an image of a controlled device, and the first image is acquired based on a camera device;

[0116] S502, obtaining a signal coverage range of the remote control transmitter, where the signal coverage range is determined based on the field of view of the remote control transmitter, and the signal coverage range overlaps with the first image;

[0117] S503, displaying a first image and displaying a first mark on the first image, where the first mark is used to represent a signal coverage range;

[0118] S504, acquiring a plurality of second images, where the plurality of second images are acquired respectively by at least two cameras in the camera device, and the second images correspond to the cameras one by one;

[0119] S505: determining a first distance between the electronic device and the controlled device based on the multiple second images;

[0120] S506. Determine a first transmission power of the remote control transmitter based on the first distance;

[0121] S507: Based on the first transmission power, control the remote control transmitter to transmit a remote control signal.

[0122] Among them, steps S501-S503 are the same as those in the above embodiment and will not be described again.

[0123] It should be noted that the process of determining the first transmission power of the remote control transmitter in steps S504-S506 is not in a fixed order with step S501. The electronic device can simultaneously obtain the first image and the second image through the camera device, or can first obtain the first image, and then obtain the second image when the distance between the electronic device and the controlled device changes and the first transmission power of the remote control transmitter needs to be adjusted. Alternatively, the first image can be determined based on multiple second images.

[0124] In step S504, the camera device includes multiple cameras, for example, two cameras including a telephoto camera and a wide-angle camera, or three cameras including a normal camera, a telephoto camera, and a wide-angle camera. When the electronic device starts the remote control application based on the first instruction, the multiple cameras in the camera device are started, and multiple second images are obtained respectively using at least two cameras, and each second image corresponds to each camera one by one.

[0125] In step S505, the electronic device calculates the first distance between the electronic device and the controlled device based on the multiple second images using a binocular distance measurement algorithm. The binocular distance measurement algorithm refers to a method of using two cameras to simultaneously shoot the same scene, and by measuring the pixel difference of the same object in the field of view of the two cameras on the image, thereby calculating the distance of the object. When the controlled object appears in the two second images at the same time, due to the baseline distance between the two cameras, the position of the controlled device in the two second images is offset (the offset is the parallax), and the distance difference between the corresponding pixel points of the controlled device in the two second images is obtained through the parallax. When the parameters such as the baseline distance and viewing angle of the two cameras are known at the same time, the three-dimensional coordinates of the controlled device can be calculated through the triangulation principle, and the first distance between the electronic device and the controlled device can be obtained by further calculation based on the three-dimensional coordinates.

[0126] In step S506, the electronic device determines a first transmission power of the remote control transmitter based on the first distance, wherein the first transmission power is positively correlated with the first distance, that is, the longer the distance between the electronic device and the controlled device, the greater the transmission power required by the remote control transmitter to remotely control the controlled device.

[0127] In some embodiments, step S506 determines a first transmission power of the remote control transmitter based on the first distance, including:

[0128] Based on the pre-stored configuration information and the first distance, a first transmission power corresponding to the first distance is determined; wherein the configuration information is used to characterize the corresponding relationship between the distance between the electronic device and the controlled device and the transmission power.

[0129] The configuration information may be table information pre-stored in the electronic device. Before the electronic device leaves the factory, after repeated experiments, the corresponding relationship between the distance between the electronic device and the controlled device and the transmission power is determined, and the corresponding relationship is summarized into a table as configuration information and pre-stored in the electronic device, so that after obtaining the first distance, the electronic device can determine the first transmission power corresponding to the first distance by looking up the configuration information table. For example, the configuration information stores a first transmission power of 10mw corresponding to the first distance of (0, 5m], a first transmission power of 15mw corresponding to the first distance of (5, 10m], and a first transmission power of 20mw corresponding to the first distance of (10, 15m]. When the first distance is determined to be 6m, the first transmission power of the remote control transmitter can be determined to be 15mw through the configuration information.

[0130] The configuration information may also be a calculation formula related to the distance and the transmission power, the calculation formula is pre-stored in the electronic device, and after obtaining the first distance, the electronic device calculates the first transmission power using the calculation formula. Obtaining the first transmission power by calculation is more accurate than obtaining the first transmission power by table lookup.

[0131] In step S507, the electronic device further calculates the corresponding driving current based on the first transmission power of the remote control transmitter, and drives the remote control transmitter with the driving current corresponding to the first transmission power, so that the remote control transmitter sends a remote control signal. Since the first transmission power is determined based on the distance between the electronic device and the controlled device, it can meet the remote control requirements of the remote control transmitter without generating unnecessary power consumption.

[0132] In the present disclosure, the electronic device uses the second image captured by the camera device to determine the first distance between the electronic device and the controlled device, and dynamically adjusts the first transmission power of the remote control transmitter based on the first distance, which can effectively reduce the power consumption of the remote control transmitter and improve the battery life of the electronic device.

[0133] The exemplary embodiment of the present disclosure provides a remote control device, which is applied to an electronic device provided with a remote control transmitter and a camera device. Figure 6 As shown, a block diagram of a remote control device shown in the present disclosure.

[0134] The block diagram includes: an acquisition module 61 and a control module 62. The acquisition module 61 is used to acquire a first image, which at least includes an image of a controlled device and is acquired based on a camera device; the acquisition module 61 is also used to acquire a signal coverage range of a remote control transmitter, which is determined based on the field of view of the remote control transmitter, and there is an overlap between the signal coverage range and the first image; the control module 62 is used to display the first image and a first mark on the first image, and the first mark is used to characterize the signal coverage range.

[0135] In an exemplary embodiment of the present disclosure, the remote control transmitter is arranged on a side of the electronic device opposite to the display screen, and the acquisition module 61 is further used to: obtain the field of view of the remote control transmitter; obtain first posture information of the electronic device relative to a preset plane; based on the field of view of the remote control transmitter and the first posture information, determine the projection range of the viewing angle range of the remote control transmitter in the first image as the signal coverage range.

[0136] In an exemplary embodiment of the present disclosure, the remote control transmitter is integrated into the camera device, and the control module 62 is further configured to start the camera device based on a first instruction to start a remote control application.

[0137] In an exemplary embodiment of the present disclosure, the control module 62 is further used to: issue first indication information based on the first instruction, where the first indication information is used to instruct to point the camera device toward the controlled device.

[0138] In an exemplary embodiment of the present disclosure, the control module 62 is also used to: store second posture information of the electronic device based on a second instruction acting on the remote control application; obtain third posture information of the electronic device within a first preset time period from the moment the second instruction is received; if the angle at which the third posture information changes in at least one direction relative to the second posture information is greater than or equal to a first preset threshold, turn off the camera device.

[0139] In an exemplary embodiment of the present disclosure, the control module 62 is further configured to: cause the electronic device to maintain the posture represented by the second posture information for a second preset time period and turn off the camera.

[0140] In an exemplary embodiment of the present disclosure, the control module 62 is also used to: obtain fourth posture information of the electronic device from the moment the camera device is turned off; if the angle of change of the fourth posture information in any direction relative to the second posture information is less than or equal to a second preset threshold, turn on the camera device.

[0141] In an exemplary embodiment of the present disclosure, the camera device includes a plurality of cameras, and the control module 62 is further configured to:

[0142] Acquire multiple second images, where the multiple second images are acquired respectively by at least two cameras in the camera device, and the second images correspond to the cameras one by one; determine a first distance between the electronic device and the controlled device based on the multiple second images; determine a first transmission power of the remote control transmitter based on the first distance; and control the remote control transmitter to transmit a remote control signal based on the first transmission power.

[0143] In an exemplary embodiment of the present disclosure, the first transmission power is positively correlated with the first distance.

[0144] In an exemplary embodiment of the present disclosure, the control module 62 is also used to: determine a first transmission power corresponding to the first distance based on pre-stored configuration information and the first distance; wherein the configuration information is used to characterize the correspondence between the distance between the electronic device and the controlled device and the transmission power.

[0145] Regarding the remote control device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0146] Figure 7 is a block diagram of an electronic device 700 according to an exemplary embodiment. For example, the electronic device 700 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0147] Reference Figure 7 , the electronic device 700 may include one or more of the following components: a processing component 702 , a memory 704 , a power component 706 , a multimedia component 708 , an audio component 710 , an input / output (I / O) interface 712 , a sensor component 714 , and a communication component 716 .

[0148] The processing component 702 generally controls the overall operation of the electronic device 700, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 702 may include one or more processors 720 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 702 may include one or more modules to facilitate the interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate the interaction between the multimedia component 708 and the processing component 702.

[0149] The memory 704 is configured to store various types of data to support operations on the electronic device 700. Examples of such data include instructions for any application or method operating on the electronic device 700, contact data, phone book data, messages, pictures, videos, etc. The memory 704 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0150] The power supply component 706 provides power to the various components of the electronic device 700. The power supply component 706 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 700.

[0151] The multimedia component 708 includes a screen that provides an output interface between the electronic device 700 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 708 includes a front camera and / or a rear camera. When the electronic device 700 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0152] The audio component 710 is configured to output and / or input audio signals. For example, the audio component 710 includes a microphone (MIC), and when the electronic device 700 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 704 or sent via the communication component 716. In some embodiments, the audio component 710 also includes a speaker for outputting audio signals.

[0153] I / O interface 712 provides an interface between processing component 702 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0154] The sensor assembly 714 includes one or more sensors for providing various aspects of status assessment for the electronic device 700. For example, the sensor assembly 714 can detect the open / closed state of the electronic device 700, the relative positioning of components, such as the display and keypad of the electronic device 700, and the sensor assembly 714 can also detect the position change of the electronic device 700 or a component of the electronic device 700, the presence or absence of user contact with the electronic device 700, the orientation or acceleration / deceleration of the electronic device 700, and the temperature change of the electronic device 700. The sensor assembly 714 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 714 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 714 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0155] The communication component 716 is configured to facilitate wired or wireless communication between the electronic device 700 and other devices. The electronic device 700 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 716 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0156] In an exemplary embodiment, the electronic device 700 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0157] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 704 including instructions, and the instructions can be executed by the processor 720 of the electronic device 700 to complete the remote control method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0158] A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of an electronic device, enables a processing device of the electronic device to execute a remote control method provided by an exemplary embodiment of the present disclosure.

[0159] Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art that are not disclosed in this disclosure. The specification and examples are to be considered exemplary only, and the true scope and spirit of the present invention are indicated by the following claims.

[0160] It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. A remote control method, characterized in that: Applicable to an electronic device provided with a remote control transmitter and a camera device, the remote control method comprises: Acquire a first image, where the first image at least includes an image of a controlled device, and the first image is acquired based on the camera device; Acquire a signal coverage range of the remote control transmitter, where the signal coverage range is determined based on a field of view of the remote control transmitter, and where there is an overlapped area between the signal coverage range and the first image; The first image is displayed and a first mark is displayed on the first image, where the first mark is used to represent the signal coverage range.

2. The remote control method according to claim 1, characterized in that: The remote control transmitter is disposed on a side of the electronic device that is away from the display screen, and obtaining the signal coverage range of the remote control transmitter includes: Obtaining the field of view of the remote control transmitter; Acquiring first posture information of the electronic device relative to a preset plane; Based on the field of view of the remote control transmitter and the first posture information, a projection range of the viewing angle of the remote control transmitter in the first image is determined as the signal coverage range.

3. The remote control method according to claim 1, characterized in that: The remote control transmitter is integrated in the camera device, and the remote control method includes: Based on a first instruction to start a remote control application, the camera device is started.

4. The remote control method according to claim 3, characterized in that: The remote control method further comprises: Based on the first instruction, first instruction information is issued, where the first instruction information is used to instruct the camera to be directed toward a controlled device.

5. The remote control method according to claim 1, characterized in that: The remote control method comprises: storing second posture information of the electronic device based on a second instruction acting on the remote control application; Acquire third posture information of the electronic device within a first preset time period from the moment when the second instruction is received; If the angle at which the third posture information changes in at least one direction relative to the second posture information is greater than or equal to a first preset threshold, the camera device is turned off.

6. The remote control method according to claim 5, characterized in that: The remote control method further comprises: The electronic device maintains the posture represented by the second posture information for a second preset time period and turns off the camera.

7. The remote control method according to claim 5, characterized in that: The remote control method further comprises: From the moment when the camera device is turned off, acquiring fourth posture information of the electronic device; If the angle at which the fourth posture information changes relative to the second posture information in any direction is less than or equal to a second preset threshold, the camera device is turned on.

8. The remote control method according to any one of claims 1 to 7, characterized in that: The camera device includes a plurality of cameras, and the remote control method further includes: Acquire a plurality of second images, where the plurality of second images are acquired respectively by at least two cameras in the camera device, and the second images correspond one to one with the cameras; Determining a first distance between the electronic device and the controlled device based on the plurality of second images; determining a first transmission power of the remote control transmitter based on the first distance; Based on the first transmission power, the remote control transmitter is controlled to transmit a remote control signal.

9. The remote control method according to claim 8, characterized in that: The remote control method further comprises: The first transmission power is positively correlated with the first distance.

10. The remote control method according to claim 8, characterized in that: The determining, based on the first distance, a first transmission power of the remote control transmitter includes: Based on pre-stored configuration information and the first distance, the first transmission power corresponding to the first distance is determined; wherein the configuration information is used to characterize the correspondence between the distance between the electronic device and the controlled device and the transmission power.

11. A remote control device, characterized in that: Applicable to electronic equipment provided with a remote control transmitter and a camera device, the remote control device comprising: An acquisition module, configured to acquire a first image, wherein the first image at least includes an image of a controlled device, and the first image is acquired based on the camera device; The acquisition module is further used to acquire a signal coverage range of the remote control transmitter, where the signal coverage range is determined based on a field of view range of the remote control transmitter, and where there is an overlapped area between the signal coverage range and the first image; A control module is used to display the first image and display a first mark on the first image, where the first mark is used to represent the signal coverage range.

12. An electronic device, characterized in that: The electronic device comprises: Remote control transmitter; Camera device; processor; a memory for storing processor-executable instructions; The processor is configured to execute the executable instructions in the memory to implement the remote control method according to any one of claims 1 to 10.

13. A non-transitory computer-readable storage medium having executable instructions stored thereon, characterized in that: When the executable instruction is executed by the processor, the remote control method according to any one of claims 1 to 10 is implemented.

Images