Device control method and apparatus, remote control device, and storage medium

Abstract

The application discloses a device control method and device, a remote control device and a storage medium, and the device control method comprises the following steps: when a touch operation is detected, controlling the remote control device to generate a laser signal based on the touch operation; receiving a reflected light signal corresponding to the laser signal, determining posture information of a trackball in the remote control device according to the reflected light signal; generating a control instruction according to the posture information, and sending the control instruction to an electronic device connected with the remote control device to control the electronic device. The device control method provided in the embodiment is simple in principle, convenient to implement, and accurate posture information of trackball rotation is obtained by using light transmission, so that accurate control of the electronic device connected with the remote control device is realized.

Description

Technical Field

[0001] This invention relates to the field of equipment control technology, and in particular to an equipment control method, apparatus, remote control device, and storage medium. Background Technology

[0002] With the development of various electronic devices, remote control devices are now available for easy control, allowing users to control these devices via touchscreen.

[0003] In remote control devices, trackballs are typically used to quickly locate control options. The principle behind this is that the trackball rotates as the user touches the screen, and this rotation causes the surrounding Hall sensors to rotate as well. The Hall sensors output the direction of the trackball's rotation based on the rotation of the trackball, and the position of the control option is then located based on this rotation direction.

[0004] Because the Hall sensor rotates with the trackball in the above method, the Hall sensor is prone to wear during rotation, which causes the rotation direction of the trackball output by the Hall sensor to be inaccurate, ultimately leading to inaccurate positioning of the control options. Therefore, the above method cannot achieve accurate control of electronic devices. Summary of the Invention

[0005] In view of the shortcomings of the prior art, the purpose of the present invention is to provide a device control method, apparatus, remote control device and storage medium to overcome the defect that control failure occurs when using a trackball to control electronic devices connected to the remote control device due to the inability to generate accurate control commands.

[0006] The technical solution adopted by this invention to solve the technical problem is as follows:

[0007] In a first aspect, this embodiment discloses a device control method, wherein the method includes:

[0008] When a touch operation is detected, the remote control device is controlled to generate a laser signal based on the touch operation;

[0009] Receive the reflected light signal corresponding to the laser signal, and determine the attitude information of the trackball in the remote control device based on the reflected light signal;

[0010] Control commands are generated based on the attitude information and sent to an electronic device connected to the remote control device to control the electronic device.

[0011] Optionally, the step of determining the attitude information of the trackball in the remote control device based on the reflected light signal includes:

[0012] The reflectivity is determined based on the laser signal and the reflected light signal corresponding to the laser signal;

[0013] The location point where the laser signal is incident on the surface of the trackball is determined based on the reflectivity.

[0014] The attitude information of the trackball in the remote control device is determined based on the location point.

[0015] Optionally, each position point on the surface of the trackball corresponds to a set of latitude and longitude coordinates; each set of latitude and longitude coordinates corresponds to a different reflectivity.

[0016] The step of locating the incident position of the laser signal on the surface of the trajectory sphere based on the reflectivity includes:

[0017] The latitude and longitude are located on the surface of the trackball based on reflectivity;

[0018] The location point where the laser signal is incident on the surface of the trackball is determined based on the latitude and longitude.

[0019] Optionally, the attitude information is the rotation direction and speed of the trackball; the step of determining the attitude information of the trackball in the remote control device based on the position point includes:

[0020] Multiple location points were determined based on the reflected light signals corresponding to multiple touch operations;

[0021] Based on the identified multiple location points, the rotation direction and speed of the trackball during the time period of multiple touch operations are determined.

[0022] The steps for generating control commands based on the attitude information include:

[0023] Control commands are generated based on the rotation direction and speed of the trackball to move the cursor position on the screen of the electronic device.

[0024] Optionally, the surface of the trackball is provided with a coating layer, the coating layer comprising multiple coating areas with different reflectivities; the type of coating in each coating area is different from the others.

[0025] Optionally, the surface of the trackball is provided with a coating layer, the coating layer comprising multiple coating areas with different reflectivities; the type of coating is the same in each coating area, but the thickness of the coating is different.

[0026] Optionally, the coating areas are arranged sequentially in a grid, and the reflectivity varies between the coating areas.

[0027] Optionally, the material of the coating layer is one or more of the following: high-reflectivity glaze, reflective paint, gypsum, white latex paint, white mud, and glass.

[0028] Secondly, this embodiment discloses a device control apparatus, comprising:

[0029] The signal generation module, when a touch operation is detected, controls the remote control device to generate a laser signal based on the touch operation;

[0030] An attitude determination module is used to receive the reflected light signal corresponding to the laser signal and determine the attitude information of the trackball in the remote control device based on the reflected light signal.

[0031] The command control module is used to generate control commands based on the attitude information and send the control commands to an electronic device connected to the remote control device to control the electronic device.

[0032] Thirdly, this embodiment discloses a remote control device, which includes a memory, a processor, and a device control program stored in the memory and executable on the processor. When the processor executes the device control program, it implements the steps of the device control method as described above.

[0033] Thirdly, this embodiment discloses a computer-readable storage medium, wherein the computer-readable storage medium stores one or more programs, which can be executed by one or more processors to implement the steps in the device control method.

[0034] Beneficial effects:

[0035] This application discloses a device control method, apparatus, remote control device, and storage medium. When a touch operation is detected, the remote control device generates a laser signal based on the touch operation; it receives the reflected light signal corresponding to the laser signal, determines the attitude information of a trackball in the remote control device based on the reflected light signal; generates a control command based on the attitude information, and sends the control command to an electronic device connected to the remote control device to control the electronic device. The device method provided by this application is simple in principle, easy to implement, and utilizes optical transmission to obtain precise attitude information of the trackball's rotation, thereby achieving accurate control of the electronic device connected to the remote control device. Attached Figure Description

[0036] Figure 1 This is a schematic flowchart illustrating the steps of the device control method according to an embodiment of the present invention;

[0037] Figure 2 This is a schematic diagram of the structure of the remote control device according to Embodiment 1 of the present invention;

[0038] Figure 3 This is a schematic diagram of the structure of the remote control device according to Embodiment 2 of the present invention;

[0039] Figure 4 This is a schematic diagram of the coating area in the coating layer of an embodiment of the present invention. Figure 1 ;

[0040] Figure 5 This is a schematic diagram of the coating area in the coating layer of an embodiment of the present invention. Figure 2 ;

[0041] Figure 6 This is a schematic diagram of the device control device in an embodiment of the present invention. Detailed Implementation

[0042] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0043] In related technologies, various electronic devices are typically equipped with remote control devices, such as wireless mice and wireless remote controls. Smart glasses can also be equipped with corresponding rings or clips to facilitate remote control of electronic devices. In these remote control devices, a trackball is used to accurately locate control options on the electronic device's screen, generating precise control commands. The trackball is spherical, and users can use their palm or fingers to rotate it, locating the cursor on the screen and selecting the desired control option. Based on this selection, control commands are then issued to the electronic device.

[0044] A trackball detects the ball's rolling direction and speed using sensors installed inside. As the trackball rolls, the sensors detect the ball's motion and convert it into electrical signals. These signals are transmitted to a computer via an encoder, which interprets them as the cursor's movement direction and speed. Once connected to a computer, the computer receives these electrical signals and controls the cursor's movement based on the corresponding direction and speed.

[0045] Furthermore, the sensor can be a sensor composed of Hall elements. In specific implementation, the mechanical rotation of the trackball drives the rotation of the Hall elements, and the output result is based on the rotation of the Hall elements. However, since Hall elements are prone to wear during rotation, and Hall elements are electronic devices that need to be waterproofed, but Hall elements that output information based on rotation cannot achieve high-performance waterproofing, when the trackball uses Hall elements to achieve cursor positioning, it cannot output accurate positioning information, and thus cannot achieve accurate control of electronic devices connected to remote control devices.

[0046] To overcome the various problems encountered with trackballs, this embodiment provides a device control method, system, remote control device, and storage medium. Specifically, in the method provided in this embodiment, when a touch operation is detected, the remote control device first generates a laser signal based on the touch operation; the reflected light signal corresponding to the laser signal is received, and the attitude information of the trackball in the remote control device is determined based on the reflected light signal; then, a control command is generated based on the attitude information of the trackball, and the control command is sent to an electronic device connected to the remote control device to control the electronic device. The method proposed in this embodiment uses light signals to locate the attitude information of the trackball, improving the accuracy of trackball attitude positioning, thereby generating accurate control commands and achieving accurate control of the electronic device connected to the remote control device.

[0047] The method provided in this embodiment is applied to a remote control device. A user issues a touch operation to the remote control device, which then sends control commands based on the touch operation to control connected electronic devices. Specifically, the remote control device has a trackball installed. The user's touch operation causes a change in the trackball's orientation, and the orientation information of the trackball is used to generate control commands for the electronic devices.

[0048] In one embodiment, when a user touches the remote control device to issue a touch operation, the touch operation triggers the transmitting module in the remote control device to generate a laser signal. The laser signal illuminates the surface of the trackball, and the surface of the trackball reflects the laser signal to generate a corresponding reflected signal. The control processing module in the remote control device determines the attitude information of the trackball based on the reflected signal, and generates a corresponding control command based on the attitude information. Based on the control command, accurate control of the electronic device connected to the remote control device is achieved.

[0049] The following description, in conjunction with the accompanying drawings, further illustrates a device control method, apparatus, remote control device, and storage medium disclosed in this embodiment.

[0050] like Figure 1 As shown, this embodiment discloses a device control method, including:

[0051] Step S1: When a touch operation is detected, the remote control device is controlled to generate a laser signal based on the touch operation.

[0052] The touch operation disclosed in this embodiment is as follows: a user issues a touch operation to a remote control device, which has a trackball installed inside and is connected to an electronic device. The user can issue control commands to the electronic device through the remote control device. The touch operation can be a left-click, a right-click, a scroll wheel rotation, or a drag, etc., and each touch operation has a corresponding control command. When the touch operation is one of the above operations, the transmitting module inside the remote control device is triggered to emit a laser signal; that is, different touch operations have corresponding laser signals.

[0053] Specifically, the transmitting module is a laser optical module, which contains a laser light source generator. The trackball is positioned in the optical path of the laser light source generator. When the user performs a touch operation on the remote control device, the laser light source generator generates a laser signal and emits it onto the surface of the trackball.

[0054] Step S2: Receive the reflected light signal corresponding to the laser signal, and determine the attitude information of the trackball in the remote control device based on the reflected light signal.

[0055] In step S1 above, when the laser signal is emitted by the transmitting module in the trackball device, the laser signal is irradiated on the surface of the trackball, and the surface of the trackball reflects the laser signal to generate a reflected light signal.

[0056] The remote control device is also equipped with a receiving module and a control processing module. The receiving module is set in the optical path of the reflected light signal to receive the reflected light signal and convert the received reflected light signal into an electrical signal to be transmitted to the control processing module. The control processing module determines the attitude information of the trackball based on the received light signal.

[0057] In detail, the steps for determining the trajectory ball's attitude information based on the reflected light signal in this process include:

[0058] The reflectivity is determined based on the laser signal and the reflected light signal corresponding to the laser signal. The position point where the laser signal is incident on the surface of the trackball is located based on the reflectivity. The attitude information of the trackball in the remote control device is determined based on the position point.

[0059] Since the laser signal illuminates the surface of the trackball, the surface reflects the received laser signal. Therefore, the reflectivity of the trackball surface to the incident laser signal can be obtained based on the incident and emitted laser signals. Because different points on the trackball surface correspond to different reflectivities, the calculated reflectivity of the laser signal can be used to locate the position point on the trackball surface corresponding to each reflected laser signal, thereby determining the trackball's attitude information at the current time or over a period of time.

[0060] Step S3: Generate control commands based on the attitude information, and send the control commands to the electronic device connected to the remote control device to control the electronic device.

[0061] Specifically, the trajectory ball's attitude information includes its rotation direction and speed. Since the reflected light signal contains the trajectory ball's rotation direction and speed, control commands are generated based on the trajectory ball's rotation direction and speed to control the movement of the cursor on the electronic device's screen, thereby achieving cursor positioning.

[0062] In this embodiment of the disclosure, there is a mapping relationship between attitude information and control commands. That is, through this mapping relationship, the corresponding control command can be determined based on the attitude information. For example, when the rotation direction is a and the rotation speed is b, the control command can be determined as A through this mapping relationship; when the rotation direction is a and the rotation speed is c, the control command can be determined as B through this mapping relationship; and when the rotation direction is d and the rotation speed is f, the control command can be determined as C through this mapping relationship.

[0063] Based on the different attitude information of the trackball, corresponding control commands are generated to control the electronic device connected to the remote control device. For example, according to the attitude information, if the trackball rotates clockwise at a certain speed and a preset angle, then the corresponding electrical signal is generated based on the attitude information, and the control command is generated based on the electrical signal to control the cursor position on the screen of the electronic device.

[0064] In another embodiment, the mapping relationship can be stored in an electronic device, that is, the remote control device can send attitude information to the electronic device, and the electronic device can determine the corresponding control command based on the mapping relationship and the attitude information, and respond to the control command.

[0065] In one embodiment, the trackball surface of the remote control device disclosed in this embodiment is provided with a coating layer. When a laser signal shines on the coating layer on the trackball surface, the coating layer surface reflects a reflected light signal. The receiving module located on the reflected light path receives the reflected light and converts the emitted light into an electrical signal before sending it to the control processing module.

[0066] Specifically, the coating layer includes multiple coating areas with different reflectivities. Different coating areas are illuminated by incident light, resulting in different reflected light and thus different electrical signals converted from the reflected light. Therefore, the control processing module can determine the attitude information of the trackball by analyzing the electrical signals, and then determine the cursor position on the screen of the electronic device.

[0067] Furthermore, based on the different placement positions of the coating layer in the trackball structure and the different fixed positions of the transmitting module, receiving module, and control processing module, the trackball device provided in this embodiment has the following two implementation methods:

[0068] Method 1:

[0069] like Figure 2 As shown, the remote control device includes: a trackball 100, a transmitting module 200, a receiving module 300, and a control processing module 400. A coating layer is provided on the outer surface of the trackball 100. The transmitting module 200, the receiving module 300, and the control processing module 400 are mounted on a circuit board, which is fixedly mounted on the outside of the trackball 100.

[0070] The transmitting module 200 is used to emit incident light signals based on the user's touch operation. In order to achieve better light energy transmission and reduce the impact of losses during transmission on the positioning results, a laser is used as the emission light source in this embodiment. Therefore, the light emitted by the transmitting module corresponds to a laser signal.

[0071] The trackball 100 is disposed in the laser signal optical path, and a coating layer 500 is disposed on the outer surface of the trackball 100. The incident light irradiates the coating layer 500 and reflects the reflected light signal. The coating layer 500 includes multiple coating areas with different reflectivities.

[0072] The receiving module 300 is disposed on the reflected light path and is used to receive the reflected light signal and convert the received reflected light into an electrical signal. The receiving module can be a camera or a light signal receiver, etc., and is used to receive the reflected light signal reflected from the coating layer, convert the received reflected light signal into an electrical signal, and transmit the electrical signal to the control processing module 400.

[0073] The control processing module 400 is connected to the receiving module 300 and is used to generate a control signal from the electrical signal and transmit the control signal to the remote control device to realize the control of the electronic device connected to the remote control device.

[0074] In this embodiment, combined with Figure 2 As shown, when the trackball 100 rotates under the user's touch operation, the position of the laser signal emitted by the transmitting module that illuminates the outer surface of the trackball changes. Since the reflectivity is different at different positions, reflected light with position code can be generated based on the different reflectivity. The reflected light with position code information is converted into an electrical signal, and a corresponding control command is generated based on the electrical signal. This control command controls the electronic device connected to the remote control device.

[0075] In detail, in order to obtain accurate reflected light signals and locate the rotation position of the trackball during rotation, the material of the coating layer is one or more of the following: high reflective glaze, reflective paint, gypsum, white latex paint, white mud, and glass.

[0076] Furthermore, in order to accurately identify the rotation position of the trackball, the surface of the trackball is coded with a coating of different reflectivity. In this embodiment, each position point on the surface of the trackball corresponds to a set of latitude and longitude; each set of latitude and longitude corresponds to a different reflectivity.

[0077] The step of locating the incident position of the laser signal on the surface of the trajectory sphere based on the reflectivity includes:

[0078] The latitude and longitude are located on the surface of the trackball based on reflectivity;

[0079] The location point where the laser signal is incident on the surface of the trackball is determined based on the latitude and longitude.

[0080] When a laser signal illuminates a point within a different coated area twice, the different reflectivities of the coating in the two areas allow for the location of two points on the trackball's surface with corresponding reflectivities based on the intensity of the reflected light. The trackball's attitude information is then determined based on these two points. If the laser signal illuminates a point within a different coated area multiple times, the varying reflectivities within the different areas allow for the location of different points on the trackball's surface. The changes in these locations determine the trackball's attitude information.

[0081] Furthermore, the attitude information includes the rotation direction and speed of the trackball; the step of determining the attitude information of the trackball in the remote control device based on the position point includes:

[0082] Multiple location points were determined based on the reflected light signals corresponding to multiple touch operations;

[0083] Based on the identified multiple location points, the rotation direction and speed of the trackball during the time period of multiple touch operations are determined.

[0084] The steps for generating control commands based on the attitude information include:

[0085] Control commands are generated based on the rotation direction and speed of the trackball to move the cursor position on the screen of the electronic device.

[0086] When a user issues multiple touch operations, the remote control device generates a corresponding laser signal for each touch operation. Since each touch operation synchronously causes the trackball to rotate, the laser signal emitted by each touch operation illuminates a different point on the trackball's surface. Therefore, the reflected light signals from multiple touch operations determine different points on the trackball's surface. Multiple touch operations can thus determine multiple points. It's conceivable that, given the potentially different directions and speeds of the trackball's rotation caused by each touch operation, the multiple points determined by multiple touch operations can be either multiple distinct points or multiple points containing the same position.

[0087] Furthermore, based on the determined multiple position points, the rotation direction and speed of the trackball during multiple touch operations can be determined. Since each touch operation corresponds to a position point on the trackball surface, multiple touch operations correspond to multiple determined position points. Based on the changing distance and duration of these changes at multiple position points, the rotation direction and speed of the trackball can be obtained. Then, based on the rotation direction and speed of the trackball, control commands can be generated to synchronize the cursor position on the screen of the electronic device with the rotation direction and speed of the trackball.

[0088] It is understandable that when a user performs one or more consecutive touch operations, the trackball will rotate. The rotation of the trackball causes the laser signal emitted by the transmitting module to illuminate different positions on the surface of the trackball. Since the reflectivity of different points on the trackball surface is different, the intensity of the reflected signal at each point will be different. Therefore, the reflected signal is converted into different electrical signals. Based on the different electrical signals, different cursor positions on the screen of the electronic device are located to achieve the positioning of the cursor position on the electronic screen.

[0089] Furthermore, each position point in each of the coating areas corresponds to a reflectance. The reflectances of multiple position points extracted from one or more adjacent coating areas illuminated by incident light are used as the position codes corresponding to the rotation information of the trackball structure, and the position codes correspond one-to-one with the cursor positions.

[0090] like Figure 4As shown, the various coated areas are arranged sequentially in a grid, and the reflectivity of each coated area varies by a certain value. For example, the outer surface of the trackball is composed of coated areas with different reflectivities. The reflectivity of the blocks in the first row from left to right is 10%, 12%, 14%, 16%, etc., and the reflectivity of the blocks in the second row from left to right is 50%, 52%, 54%, 56%. Taking five incident points as positioning points as an example, each of them corresponds to a pixel value. The values ​​of the top left and middle points are the same, corresponding to 10% reflectivity. The top right point has 12% reflectivity, the bottom left point has 50% reflectivity, and the bottom right point has 52% reflectivity. These positions can be recorded as [10, 12, 10, 50, 52]. When the incident point moves to the second row, the position of the incident light illuminating the outer surface of the trackball can be located as [12, 14, 12, 52, 54]. Based on the positional changes of the trackball in the two images, we can deduce that the trackball moved one unit to the left. The exact amount of movement can be determined by the numerical values ​​in the two trackball images.

[0091] In one embodiment, the coating layer on the trackball surface can either cover the entire surface of the trackball or be distributed only on half of the surface. For example... Figure 5 As shown, the coating layer also includes multiple coating areas with the same reflectivity. When incident light shines on an area of ​​the coating with the same reflectivity, the position of the cursor remains unchanged.

[0092] Furthermore, the reflectivity value on the coating layer decreases or increases sequentially with the change of latitude and longitude values ​​on the surface of the coating layer; the reflectivity corresponding to each latitude and longitude is used as the position code for the rotation information of the trackball structure, and the position code corresponds one-to-one with the cursor position.

[0093] In one embodiment, the trackball surface is coated with a paint layer comprising multiple coated areas with different reflectivities; the type of paint in each coated area is different. Different types of paint are used to coat the trackball surface to achieve different reflectivities in different areas.

[0094] In another embodiment, the coating layers on the surface of the trackball are of the same material type but have different thicknesses, thereby achieving different reflectivities in different locations.

[0095] After receiving the electrical signal, the control processing module positions the cursor on the display screen according to the corresponding control command. For example, if the cursor was positioned to select the music app after the previous trackball rotation, and the trackball rotation indicates a one-space left movement, the cursor will still be selected. If the trackball rotation indicates a one-space right movement, the cursor will be moved to select the calendar. (In practice, depending on user experience, multiple leftward movements can be used to switch between apps. Similarly, this can be used in dropdown menus, and in reading, music, or short video apps to switch to the next page, next song, etc.)

[0096] Method 2:

[0097] like Figure 3 As shown, the remote control device includes: a transmitting module, a trackball, a spherical shell located below the trackball, a receiving module, and a control processing module.

[0098] A spherical outer shell is positioned below the trackball, and a coating layer is applied to the inner surface of the outer shell. The transmitting module, receiving module, and control processing module are mounted on a circuit board, which is fixedly positioned inside the trackball. Both the receiving module 300 and the transmitting module 200 are connected to the control processing module 400.

[0099] The transmitting module 200 is used to emit laser signal light; the trackball 100 is used to receive user touch operations and rotate. In this embodiment, a coating layer is disposed on a spherical shell, which is fixedly disposed below the trackball, and the inner surface of the shell is provided with a coating layer 500.

[0100] In a specific implementation, the outer shell can be a hemispherical shell or a spherical shell. In order to achieve more accurate positioning, if the outer shell is hemispherical in this embodiment, multiple receiving modules can be set to receive the reflected light signal and capture images from different angles.

[0101] The laser signal irradiates the coating layer and reflects a reflected light signal. The coating layer includes multiple coating areas with different reflectivities. A receiving module 300 is disposed in the optical path of the reflected light signal to receive the reflected light signal and convert the received reflected light signal into an electrical signal. A control processing module 400 is connected to the receiving module 300. The control processing module 400 analyzes the electrical signals received by the receiving module 300 before and after the trackball 100 rotates, and determines the cursor position based on the analysis results.

[0102] In this embodiment, a coating layer is disposed on the inner surface of the outer shell below the trackball, while the transmitting module, receiving module, and control processing module are disposed inside the trackball and mounted on a circuit board. When the trackball rotates, the circuit board rotates synchronously with the trackball. The laser emitted by the transmitting module illuminates the inner surface of the outer shell, and the coating layer on the inner surface reflects the incident light. After receiving the reflected light, the receiving module converts it into an electrical signal. This electrical signal can be interpreted as the position and angle information of the cursor, and the control processing module can then locate the cursor position based on this electrical signal.

[0103] Based on the above-described equipment control method, this embodiment also discloses an equipment control device. Figure 6 As shown, the device control unit includes a signal generation module 610, an attitude determination module 620, and a command control module 630.

[0104] The signal generation module 610, when a touch operation is detected, controls the remote control device to generate a laser signal based on the touch operation; its function is as described in step S1.

[0105] The attitude determination module 620 is used to receive the reflected light signal corresponding to the laser signal and determine the attitude information of the trackball in the remote control device based on the reflected light signal; its function is as described in step S2.

[0106] The instruction control module 630 is used to generate control instructions based on the attitude information and send the control instructions to an electronic device connected to the remote control device to control the electronic device, and its function is as described in step S3.

[0107] Furthermore, the attitude determination module 620 includes: a reflectivity determination unit, a position point determination unit, and an attitude determination unit;

[0108] The reflectivity determination unit is used to determine the reflectivity based on the laser signal and the reflected light signal corresponding to the laser signal;

[0109] The location point determination unit is used to locate the incident location of the laser signal on the surface of the trajectory sphere based on the reflectivity.

[0110] The attitude determination unit is used to determine the attitude information of the trackball in the remote control device based on the position point.

[0111] Furthermore, each position point on the surface of the trackball corresponds to a set of latitude and longitude coordinates; each set of latitude and longitude coordinates corresponds to a different reflectivity.

[0112] The unit for determining location points includes: a latitude and longitude determination subunit;

[0113] The latitude and longitude determination subunit is used to locate the latitude and longitude on the surface of the trackball based on the reflectivity; and to determine the incident position of the laser signal on the surface of the trackball based on the latitude and longitude.

[0114] Furthermore, the attitude determination module also includes: a position change calculation unit;

[0115] The position change calculation unit is used to determine the rotation direction and speed of the trackball during the time period of multiple touch operations based on multiple position points determined by the reflected light signals corresponding to multiple touch operations.

[0116] Furthermore, the surface of the trackball is provided with a coating layer, which includes multiple coating areas with different reflectivities; the type of coating in each coating area is different from the others.

[0117] Furthermore, the surface of the trackball is provided with a coating layer, which includes multiple coating areas with different reflectivities; the type of coating is the same in each coating area, but the thickness of the coating is different.

[0118] Furthermore, the coating areas are arranged sequentially in a grid pattern, and the reflectivity varies between the coating areas.

[0119] Specifically, the control method and device control apparatus provided in this embodiment can be applied to AR glasses. The AR glasses are equipped with a display screen for playing content. The AR glasses are connected to a trackball. The user triggers the control button of the AR glasses to issue a touch operation. The transmitting module in the AR glasses emits a laser signal based on the touch operation. The laser signal is incident on the surface of the trackball and generates a reflected light signal. The receiving module in the AR glasses receives the reflected light signal and converts it into an electrical signal, which is then transmitted to the control processing module. The control processing module generates corresponding control commands based on the received electrical signal to control the electronic device connected to the trackball.

[0120] This embodiment also provides a remote control device, which includes: a memory, a processor, and a device control program stored in the memory and executable on the processor. When the processor executes the device control program, it implements the steps of the device control method as described above.

[0121] If the memory, processor, and communication interface are implemented independently, they can be interconnected via a bus to communicate with each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc.

[0122] Alternatively, in a specific implementation, if the memory, processor, and communication interface are integrated on a single chip, then the memory, processor, and communication interface can communicate with each other through an internal interface.

[0123] The processor may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of this application.

[0124] This embodiment utilizes a coating layer on the surface of a trackball to construct a reflectivity code. When the trackball rotates, the reflectivity of the material in different areas of the coating layer illuminated by the laser signal varies, resulting in different reflected light signals received by the receiving module. This allows the trackball's attitude information to be located, and control commands are generated based on this attitude information to control the movement of the cursor. The device and method provided in this embodiment are simple in principle, easy to implement, and utilize optical transmission to obtain precise attitude information of the trackball's rotation, thereby achieving accurate control of electronic devices connected to remote control equipment.

[0125] Based on the methods and apparatus disclosed above, this embodiment also discloses a computer-readable storage medium, characterized in that the computer-readable storage medium stores one or more programs, which can be executed by one or more processors to implement the steps in the device control method.

[0126] This embodiment discloses a device control method, apparatus, remote control device, and storage medium. The method involves controlling the remote control device to generate a laser signal based on the touch operation when a touch operation is detected; receiving the reflected light signal corresponding to the laser signal; determining the attitude information of the trackball in the remote control device based on the reflected light signal; generating a control command based on the attitude information; and sending the control command to an electronic device connected to the remote control device to control the electronic device.

[0127] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.

[0128] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable storage medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-included system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable storage medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable storage media include: an electrical connection having one or more wires (electronic device), a portable computer disk drive (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Alternatively, the computer-readable storage medium could be paper or other suitable media on which the program can be printed, since the program can be obtained electronically by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in a computer memory.

[0129] It should be understood that the various parts of this application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, the N steps or methods can be implemented using software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0130] Those skilled in the art will understand that all or part of the steps of the methods in the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, the program includes one or a combination of the steps of the method embodiments.

[0131] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the invention patent. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this patent application should be determined by the appended claims.

Claims

1. A device control method, characterized in that, The method includes: When a touch operation is detected, the remote control device is controlled to generate a laser signal based on the touch operation; Receive the reflected light signal corresponding to the laser signal, and determine the attitude information of the trackball in the remote control device based on the reflected light signal; A control command is generated based on the attitude information, and the control command is sent to an electronic device connected to the remote control device to control the electronic device; The surface of the trackball is coated with a coating layer, which includes multiple coating areas with different reflectivities; the type of coating in each coating area is different, or the type of coating in each coating area is the same, but the thickness of the coating is different. Each position point in each of the coating areas corresponds to a reflectance. The reflectance of multiple position points extracted from one or more adjacent coating areas illuminated by incident light is used as the position code corresponding to the rotation information of the trackball structure, and the position code corresponds one-to-one with the cursor position. The step of receiving the reflected light signal corresponding to the laser signal and determining the attitude information of the trackball in the remote control device based on the reflected light signal includes: Based on the different reflectivities, reflected light signals with position codes are generated. These reflected light signals with position codes are then converted into electrical signals. By analyzing the electrical signals, the attitude information of the trackball is determined.

2. The equipment control method according to claim 1, characterized in that, The step of determining the attitude information of the trackball in the remote control device based on the reflected light signal includes: The reflectivity is determined based on the laser signal and the reflected light signal corresponding to the laser signal; The location point where the laser signal is incident on the surface of the trackball is determined based on the reflectivity. The attitude information of the trackball in the remote control device is determined based on the location point.

3. The equipment control method according to claim 2, characterized in that, Each point on the surface of the trackball corresponds to a set of latitude and longitude coordinates; each set of latitude and longitude coordinates corresponds to a different reflectivity; The step of locating the incident position of the laser signal on the surface of the trajectory sphere based on the reflectivity includes: The latitude and longitude are located on the surface of the trackball based on reflectivity; The location point where the laser signal is incident on the surface of the trackball is determined based on the latitude and longitude.

4. The equipment control method according to claim 2, characterized in that, The attitude information refers to the rotation direction and speed of the trackball; The step of determining the attitude information of the trackball in the remote control device based on the position point includes: Multiple location points were determined based on the reflected light signals corresponding to multiple touch operations; Based on the identified multiple location points, the rotation direction and speed of the trackball during the time period of multiple touch operations are determined. The steps for generating control commands based on the attitude information include: Control commands are generated based on the rotation direction and speed of the trackball to move the cursor position on the screen of the electronic device.

5. The equipment control method according to claim 1, characterized in that, The coating areas are arranged sequentially in a grid pattern, and the reflectivity varies equally between the coating areas.

6. A device control apparatus, characterized in that, include: The signal generation module, when a touch operation is detected, controls the remote control device to generate a laser signal based on the touch operation; An attitude determination module is used to receive the reflected light signal corresponding to the laser signal and determine the attitude information of the trackball in the remote control device based on the reflected light signal. The command control module is used to generate control commands based on the attitude information and send the control commands to an electronic device connected to the remote control device to control the electronic device; The surface of the trackball is coated with a coating layer, which includes multiple coating areas with different reflectivities; the type of coating in each coating area is different, or the type of coating in each coating area is the same, but the thickness of the coating is different. Each position point in each of the coating areas corresponds to a reflectance. The reflectance of multiple position points extracted from one or more adjacent coating areas illuminated by incident light is used as the position code corresponding to the rotation information of the trackball structure, and the position code corresponds one-to-one with the cursor position. The step of receiving the reflected light signal corresponding to the laser signal and determining the attitude information of the trackball in the remote control device based on the reflected light signal includes: Based on the different reflectivities, reflected light signals with position codes are generated. These reflected light signals with position codes are then converted into electrical signals. By analyzing the electrical signals, the attitude information of the trackball is determined.

7. A remote control device, characterized in that, include: A memory, a processor, and a device control program stored in the memory and executable on the processor, wherein when the processor executes the device control program, it implements the steps of the device control method as described in any one of claims 1-5.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores one or more programs that can be executed by one or more processors to implement the steps of the device control method as described in any one of claims 1-5.

Images