An AI intelligent peripheral equipment management system and method based on the Internet of Things

Abstract

The present invention discloses an AI intelligent peripheral device management system and method based on the Internet of Things, belonging to the technical field of device management. The present invention comprises: S10: predicting the hovering index of the AI ​​intelligent peripheral device at each cursor hovering position; S20: predicting the operation instruction of the AI ​​intelligent peripheral device at the next moment; S30: predicting the drop-down height of the cursor; S40: determining the scrolling distance of the roller set on the AI ​​intelligent peripheral device. The present invention uses line segments to connect the target keywords according to the distribution of the position coordinates of each target keyword displayed in the jump interface of the intelligent terminal, and predicts the discrete coefficient of each target keyword displayed in the jump interface based on the connection processing result. Based on the prediction result, the scrolling distance of the roller set on the AI ​​intelligent peripheral device is determined, which is conducive to the AI ​​intelligent peripheral device to locate the key content in the target content to be found.

Description

Technical Field

[0001] The present invention relates to the technical field of device management, and in particular to an AI intelligent peripheral device management system and method based on the Internet of Things. Background Art

[0002] AI smart mouse is a mouse that integrates artificial intelligence technology. It not only has the basic functions of a traditional mouse, but also can provide more advanced interactive experience and auxiliary functions.

[0003] In the prior art, the smart mouse cannot determine the movement of the smart mouse at the next moment according to the user's operation gesture, cannot autonomously search for the target content to be found by the user according to the display content on the display screen of the smart terminal, and cannot automatically locate the key content in the target content to be found, which reduces the user's usage experience. Summary of the invention

[0004] The purpose of the present invention is to provide an AI intelligent peripheral device management system and method based on the Internet of Things to solve the problems raised in the above background technology.

[0005] In order to solve the above technical problems, the present invention provides the following technical solutions: an AI intelligent peripheral device management method based on the Internet of Things, the method comprising:

[0006] S10: A microphone, a sensor, and a micro camera are placed in the AI ​​smart peripheral device. After the user authorizes, the microphone recognizes the voice command input by the user, and the micro camera collects the display content in the display screen of the smart terminal connected to the AI ​​smart peripheral device. Based on the collected information, the hovering index of the AI ​​smart peripheral device at each cursor hovering position is predicted;

[0007] S20: Based on the predicted hovering index and the user operation gestures collected by the sensor, the operation command of the AI ​​intelligent peripheral device at the next moment is predicted;

[0008] S30: When the AI ​​intelligent peripheral device executes the predicted operation instruction, the micro camera collects the display content in the jump interface of the intelligent terminal, and predicts the drop-down height of the cursor based on the collected information;

[0009] S40: Determine a scrolling distance of a scroll wheel set on the AI ​​smart peripheral device according to the predicted pull-down height.

[0010] Further, the S10 includes:

[0011] S101: After the user authorizes, the microphone recognizes the voice command input by the user, and the AI ​​intelligent peripheral device controls the intelligent terminal to perform corresponding operations according to the recognized voice command. After the intelligent terminal enters the target interface, the micro camera collects the display content on the display screen of the intelligent terminal;

[0012] S102: According to the voice command recognized by the microphone, the target content and target keyword that the user is looking for are determined, a plane coordinate system is constructed with the upper left corner of the display screen as the coordinate origin, the horizontal right direction from the coordinate origin is set as the positive direction of the X axis, and the horizontal downward direction from the coordinate origin is set as the positive direction of the Y axis, the position coordinates of each target keyword displayed in the target interface are obtained, the first word position of the title where the target keyword is located is used as the cursor hovering position, and the hovering index of each cursor hovering position is predicted. The specific prediction method is:

[0013] According to the formula The matching degree between the title content of each title displayed in the target interface and the target content sought by the user is calculated, where i=1,2,…,m, represents the number corresponding to each title displayed in the target interface, and m represents the total number of titles in the target interface. Indicates the number of times the target keyword appears in the title numbered i. Indicates the degree of match between the title content of the title numbered i and the target content that the user is looking for;

[0014] The distance between the cursor position numbered i and the cursor initial hovering position is calculated using the distance formula between two points. Perform calculations;

[0015] according to The hover index of each cursor hover position is predicted, where: The hover index representing the position where the cursor number i is hovered.

[0016] Further, the S20 includes:

[0017] S201: determining a movement trajectory of the cursor according to the predicted hover index, and the AI ​​intelligent peripheral device controls the cursor to move according to the determined movement trajectory. During the movement of the cursor, the sensor collects the user's operation gestures, and the operation gestures include clicking and sliding;

[0018] S202: numbering each operation gesture according to the collection time sequence of the operation gestures, and the numbering result is: j=1,2,…,n, where n represents the total number, based on the collection time of each operation gesture , and the standard moving speed v of the cursor, the position coordinates of the offset point of the moving track are determined. The specific determination method is:

[0019] according to The distance value between the moving trajectory offset point and the initial hovering position of the cursor is calculated. In the moving trajectory, the distance value between each trajectory point and the initial hovering position of the cursor is obtained. When the obtained distance value is equal to L, the corresponding trajectory point is the moving trajectory offset point, and the position coordinates of the moving trajectory offset point are the position coordinates of the corresponding trajectory point in the coordinate system;

[0020] S203: predicting the operation instruction of the AI ​​intelligent peripheral device at the next moment according to the collected user operation gestures. The specific prediction method is as follows:

[0021] Ⅰ. When the user's operation gesture at the offset point of the moving track is a click, the operation instruction of the AI ​​smart peripheral device at the next moment is a pull-down operation;

[0022] Ⅱ. When the user's operation gesture at the offset point of the moving track is sliding, the moving track of the cursor is adjusted according to the sliding direction and sliding range of the operation gesture. The specific adjustment method is as follows:

[0023] According to the sliding range of the operation gesture, the moving distance R of the cursor is determined. , if the sliding direction of the user's operation gesture is vertically upward, the position coordinates of the cursor when it stops moving are , if the sliding direction of the user's gesture is vertically downward, the position coordinates of the cursor when it stops moving are , remove the cursor hovering position within the sliding range of the operation gesture, and remove the distance between the cursor stop position according to the distance formula between two points. Calculate, connect each cursor hovering position with a line segment in order of distance values ​​from small to large, connect the cursor hovering position and the cursor stop position corresponding to minT with a line segment, and obtain the adjusted motion trajectory, where min represents the minimum value symbol;

[0024] in, Indicates the sliding distance value of the operation gesture numbered j, E indicates the maximum sliding distance allowed by the AI ​​smart peripheral device at a time, and H indicates the distance the cursor moves at the maximum sliding distance. is the position coordinate of the offset point of the moving trajectory;

[0025] III. When the cursor is at the cursor stop position, the AI ​​intelligent peripheral device controls the cursor to move according to the adjusted moving trajectory. At the same time, the sensor collects the user's operation gesture and repeats the operations of I and II in S202 and S203 until the user's operation gesture at the offset point of the moving trajectory is a click.

[0026] Further, the S30 includes:

[0027] The position coordinates of each target keyword displayed in the smart terminal jump interface are obtained, a position coordinate is randomly selected, and the distance value of the selected position coordinate from the position coordinates corresponding to each target keyword that has not been selected is calculated using the distance formula between two points. Calculate according to min The position coordinates of the target keywords that were not selected are obtained, and the selected position coordinates are connected with the obtained position coordinates by using a line segment. The position coordinates will not participate in the calculation of subsequent distance values ​​after selection. The last selected position coordinates are connected with the position coordinates corresponding to each target keyword that was not selected by using a line segment;

[0028] Predict the discrete coefficient of each target keyword displayed in the jump interface. The specific calculation formula is:

[0029] ;

[0030] Wherein, c=1,2,…,C, represents the number value corresponding to each target keyword displayed in the jump interface, and C represents the total number of target keywords displayed in the jump interface. represents the number of connection edges between target keywords connected to the target keyword numbered c, Indicates the total number of target keywords connected to the target keyword numbered c. represents the discrete coefficient of the target keyword numbered c;

[0031] In the jump interface, max The position coordinates of the corresponding target keyword are obtained, and the ordinate of the obtained position coordinates is the drop-down height value s of the cursor, where max represents the maximum value symbol.

[0032] Further, the S40 includes: according to The scrolling distance of the scroll wheel set on the AI ​​smart peripheral device is determined, and the AI ​​smart peripheral device controls the scroll wheel to move according to the determined scrolling distance.

[0033] An AI intelligent peripheral device management system based on the Internet of Things, the system comprising a hover index prediction module, an operation instruction prediction module, a pull-down height prediction module and an AI intelligent peripheral device management module;

[0034] The hover index prediction module is used to predict the hover index of the AI ​​intelligent peripheral device at each cursor hovering position;

[0035] The operation instruction prediction module is used to predict the operation command of the AI ​​intelligent peripheral device at the next moment;

[0036] The pull-down height prediction module is used to predict the pull-down height of the cursor;

[0037] The AI ​​intelligent peripheral device management module is used to determine the scrolling distance of the roller set on the AI ​​intelligent peripheral device.

[0038] Further, the hover index prediction module includes an information collection unit, a matching degree calculation unit and a hover index prediction unit;

[0039] After the user authorizes, the information collection unit recognizes the voice command input by the user through the microphone and collects the display content on the display screen of the smart terminal through the micro camera;

[0040] The matching degree calculation unit calculates the matching degree between the title content of each title displayed in the target interface and the target content sought by the user according to the calculation formula;

[0041] The hover index prediction unit calculates the distance value between each cursor hovering position and the cursor initial hovering position by using the distance formula between two points, and predicts the hover index of each cursor hovering position in combination with the calculation result transmitted by the matching degree calculation unit.

[0042] Further, the operation instruction prediction module includes a cursor movement trajectory determination unit, a movement trajectory offset point determination unit and an operation command prediction unit;

[0043] The cursor movement trajectory determination unit determines the movement trajectory of the cursor according to the prediction result transmitted by the hover index prediction unit;

[0044] When the cursor moves along the determined moving trajectory, the moving trajectory offset point collects the user's operation gestures through the sensor, and determines the position coordinates of the moving trajectory offset point based on the collection time of each collected operation gesture and the standard moving speed of the cursor;

[0045] The operation command prediction unit predicts the operation command of the AI ​​intelligent peripheral device at the next moment according to the user operation gesture collected by the sensor.

[0046] Further, the pull-down height prediction module includes a connection processing unit, a discrete coefficient prediction unit and a cursor pull-down height prediction unit;

[0047] The connection processing unit obtains the position coordinates of each target keyword displayed in the jump interface of the intelligent terminal, randomly selects a position coordinate, calculates the distance value between the selected position coordinate and the position coordinates corresponding to each unselected target keyword by using a distance formula between two points, and based on the calculation result, selectively connects the selected position coordinate with the position coordinates corresponding to each unselected target keyword by using a line segment;

[0048] The discrete coefficient prediction unit predicts the discrete coefficient of each target keyword displayed in the jump interface according to the connection result of the connection processing unit;

[0049] The cursor pull-down height prediction unit receives the prediction result transmitted by the discrete coefficient prediction unit, and predicts the cursor pull-down height based on the received information.

[0050] Furthermore, the AI ​​intelligent peripheral device management module determines the scrolling distance of the roller set on the AI ​​intelligent peripheral device according to the constructed prediction model, and the AI ​​intelligent peripheral device controls the roller to move according to the determined scrolling distance.

[0051] Compared with the prior art, the beneficial effects achieved by the present invention are:

[0052] 1. The present invention searches for target keywords in the display screen of the smart terminal through a microphone and a micro camera installed in an AI smart peripheral device, and determines the cursor hovering position according to the search results. The hovering index of the cursor at each cursor hovering position is predicted based on the matching degree between the title content of each title displayed in the target interface and the target content sought by the user, as well as the distance value between each cursor hovering position and the initial cursor hovering position. Based on the prediction result, the movement trajectory of the cursor can be determined, which further shortens the user's search time for the target content. At the same time, it improves the user's search accuracy for the target content and improves the use effect of the system.

[0053] 2. The present invention determines the offset point of the cursor's moving trajectory according to the collection time of the user's operation gesture collected by the sensor, and predicts the operation instructions of the AI ​​smart peripheral device at the next moment in combination with the user's operation gesture, thereby improving the interactive experience of the AI ​​smart peripheral device.

[0054] 3. The present invention uses line segments to connect the target keywords according to the distribution of the position coordinates of each target keyword displayed in the jump interface of the smart terminal, and predicts the discrete coefficients of each target keyword displayed in the jump interface based on the connection processing results. Based on the prediction results, the scrolling distance of the roller set on the AI ​​smart peripheral device is determined, which is beneficial for the AI ​​smart peripheral device to locate the key content in the target content being sought, and improves the system's management effect on the AI ​​smart peripheral device. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0056] Figure 1 It is a workflow diagram of an AI intelligent peripheral device management system and method based on the Internet of Things of the present invention;

[0057] Figure 2 It is a structural schematic diagram of the working principle of an AI intelligent peripheral device management system and method based on the Internet of Things of the present invention. DETAILED DESCRIPTION

[0058] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0059] See also Figure 1 and Figure 2 The present invention provides a technical solution: an AI intelligent peripheral device management method based on the Internet of Things, the method comprising:

[0060] S10: A microphone, a sensor, and a micro camera are placed in the AI ​​smart peripheral device. The AI ​​smart peripheral device may be a mouse. After authorization by the user, the microphone recognizes the voice command input by the user, and the micro camera collects the display content on the display screen of the smart terminal connected to the AI ​​smart peripheral device. The smart terminal may be a computer. Based on the collected information, the hovering index of the AI ​​smart peripheral device at each cursor hovering position is predicted;

[0061] S10 includes:

[0062] S101: After the user authorizes, the microphone recognizes the voice command input by the user, and the AI ​​intelligent peripheral device controls the intelligent terminal to perform corresponding operations according to the recognized voice command. After the intelligent terminal enters the target interface, the micro camera collects the display content on the display screen of the intelligent terminal;

[0063] S102: According to the voice command recognized by the microphone, the target content and target keyword that the user is looking for are determined. For example, if the voice command recognized by the microphone is "search what AI smart peripheral recognition includes", the target content that the user is looking for is "what AI smart peripheral devices include", and the target keyword is "AI smart peripheral devices". A plane coordinate system is constructed with the upper left corner of the display screen as the coordinate origin, and the horizontal right direction from the coordinate origin is set as the positive direction of the X axis, and the horizontal downward direction from the coordinate origin is set as the positive direction of the Y axis. The position coordinates of each target keyword displayed in the target interface are obtained, and the first word position of the title where the target keyword is located is used as the cursor hovering position. The hovering index of each cursor hovering position is predicted. The specific prediction method is:

[0064] According to the formula The matching degree between the title content of each title displayed in the target interface and the target content sought by the user is calculated, where i=1,2,…,m, represents the number corresponding to each title displayed in the target interface, and m represents the total number of titles in the target interface. Indicates the number of times the target keyword appears in the title numbered i. Indicates the degree of match between the title content of the title numbered i and the target content that the user is looking for;

[0065] The distance between the cursor position numbered i (the cursor position numbered i refers to the position of the first letter of the title numbered i) and the initial cursor position is calculated using the distance formula between two points. The initial hovering position of the cursor refers to the position where the cursor hovers in the target interface when the smart terminal enters the target interface;

[0066] according to The hover index of each cursor hover position is predicted, where: Indicates the hover index of the cursor position numbered i, where the hover index refers to the probability of the cursor hovering at the corresponding position;

[0067] S20: Based on the predicted hovering index and the user operation gestures collected by the sensor, the operation command of the AI ​​intelligent peripheral device at the next moment is predicted;

[0068] The S20 includes:

[0069] S201: Determine a movement trajectory of the cursor according to the predicted hover index. The method for determining the movement trajectory is: connect each cursor hovering position with a line segment in descending order of the hover index, connect the cursor hovering position corresponding to the maximum hovering index with the initial cursor hovering position with a line segment, and obtain the movement trajectory of the cursor. The AI ​​intelligent peripheral device controls the cursor to move according to the determined movement trajectory. During the movement of the cursor, the sensor collects the user's operation gestures, and the operation gestures include clicking and sliding.

[0070] S202: numbering each operation gesture according to the collection time sequence of the operation gestures, and the numbering result is: j=1,2,…,n, where n represents the total number, based on the collection time of each operation gesture , and the standard moving speed v of the cursor. The standard moving speed refers to the moving speed of the cursor when the AI ​​intelligent peripheral device moves autonomously without external force. The position coordinates of the offset point of the moving trajectory are determined. The specific determination method is:

[0071] according to The distance value between the moving trajectory offset point and the initial hovering position of the cursor is calculated. In the moving trajectory, the distance value between each trajectory point and the initial hovering position of the cursor is obtained. When the obtained distance value is equal to L, the corresponding trajectory point is the moving trajectory offset point, and the position coordinates of the moving trajectory offset point are the position coordinates of the corresponding trajectory point in the coordinate system;

[0072] S203: predicting the operation instruction of the AI ​​intelligent peripheral device at the next moment according to the collected user operation gestures. The specific prediction method is as follows:

[0073] Ⅰ. When the user's operation gesture at the offset point of the moving track is a click, the operation instruction of the AI ​​smart peripheral device at the next moment is a pull-down operation;

[0074] Ⅱ. When the user's operation gesture at the offset point of the moving track is sliding, the moving track of the cursor is adjusted according to the sliding direction and sliding range of the operation gesture. The specific adjustment method is as follows:

[0075] According to the sliding range of the operation gesture, the moving distance R of the cursor is determined. , if the sliding direction of the user's operation gesture is vertically upward, the position coordinates of the cursor when it stops moving are , if the sliding direction of the user's gesture is vertically downward, the position coordinates of the cursor when it stops moving are , remove the cursor hovering position within the sliding range of the operation gesture, and remove the distance between the cursor stop position according to the distance formula between two points. Calculate, connect each cursor hovering position with a line segment in order of distance values ​​from small to large, connect the cursor hovering position and the cursor stop position corresponding to minT with a line segment, and obtain the adjusted motion trajectory, where min represents the minimum value symbol;

[0076] in, Indicates the sliding distance value of the operation gesture numbered j. E indicates the maximum sliding distance allowed by the AI ​​smart peripheral device at a time. E=(1 / 3)*wheel circumference. H indicates the distance the cursor moves at the maximum sliding distance. is the position coordinate of the offset point of the moving trajectory;

[0077] III. When the cursor is at the cursor stop position, the AI ​​intelligent peripheral device controls the cursor to move according to the adjusted moving trajectory. At the same time, the sensor collects the user's operation gesture and repeats the operations of I and II in S202 and S203 until the user's operation gesture at the offset point of the moving trajectory is a click;

[0078] S30: When the AI ​​intelligent peripheral device executes the predicted operation instruction, the micro camera collects the display content in the jump interface of the intelligent terminal, and predicts the drop-down height of the cursor based on the collected information;

[0079] S30 includes:

[0080] The position coordinates of each target keyword displayed in the smart terminal jump interface are obtained, a position coordinate is randomly selected, and the distance value of the selected position coordinate from the position coordinates corresponding to each target keyword that has not been selected is calculated using the distance formula between two points. Calculate according to min The position coordinates of the target keywords that were not selected are obtained, and the selected position coordinates are connected with the obtained position coordinates by using a line segment. The position coordinates will not participate in the calculation of subsequent distance values ​​after selection. The last selected position coordinates are connected with the position coordinates corresponding to each target keyword that was not selected by using a line segment;

[0081] Predict the discrete coefficient of each target keyword displayed in the jump interface. The specific calculation formula is:

[0082] ;

[0083] Wherein, c=1,2,…,C, represents the number value corresponding to each target keyword displayed in the jump interface, and C represents the total number of target keywords displayed in the jump interface. represents the number of connection edges between target keywords connected to the target keyword numbered c, Indicates the total number of target keywords connected to the target keyword numbered c. Indicates the dispersion coefficient of the target keyword numbered c. The dispersion coefficient refers to the dispersion value of the target keyword numbered c compared with other target keywords in the jump interface;

[0084] In the jump interface, max The position coordinates of the corresponding target keyword are obtained, and the ordinate of the obtained position coordinates is the drop-down height value s of the cursor, where max represents the maximum value symbol;

[0085] S40: Determine a scrolling distance of a scroll wheel set on the AI ​​smart peripheral device according to the predicted pull-down height;

[0086] S40 includes: The scrolling distance of the scroll wheel set on the AI ​​smart peripheral device is determined, and the AI ​​smart peripheral device controls the scroll wheel to move according to the determined scrolling distance.

[0087] An AI intelligent peripheral device management system based on the Internet of Things, the system includes a hover index prediction module, an operation instruction prediction module, a drop-down height prediction module and an AI intelligent peripheral device management module;

[0088] The hover index prediction module is used to predict the hover index of the AI ​​intelligent peripheral device at each cursor hovering position;

[0089] The hovering index prediction module includes an information collection unit, a matching degree calculation unit and a hovering index prediction unit;

[0090] After the user authorizes, the information collection unit recognizes the voice command input by the user through the microphone and collects the display content on the display screen of the smart terminal through the micro camera;

[0091] The matching degree calculation unit calculates the matching degree between the title content of each title displayed in the target interface and the target content sought by the user according to the calculation formula;

[0092] The hover index prediction unit calculates the distance value between each cursor hovering position and the cursor initial hovering position by using the distance formula between two points, and predicts the hover index of each cursor hovering position in combination with the calculation result transmitted by the matching degree calculation unit;

[0093] The operation instruction prediction module is used to predict the operation command of the AI ​​intelligent peripheral device at the next moment;

[0094] The operation instruction prediction module includes a cursor movement trajectory determination unit, a movement trajectory offset point determination unit and an operation command prediction unit;

[0095] The cursor movement trajectory determination unit determines the movement trajectory of the cursor according to the prediction result transmitted by the hover index prediction unit;

[0096] When the cursor moves along the determined moving trajectory, the moving trajectory offset point collects the user's operation gestures through the sensor, and determines the position coordinates of the moving trajectory offset point based on the collection time of each collected operation gesture and the standard moving speed of the cursor;

[0097] The operation command prediction unit predicts the operation command of the AI ​​intelligent peripheral device at the next moment based on the user operation gestures collected by the sensor;

[0098] The drop-down height prediction module is used to predict the drop-down height of the cursor;

[0099] The pull-down height prediction module includes a connection processing unit, a discrete coefficient prediction unit and a cursor pull-down height prediction unit;

[0100] The connection processing unit obtains the position coordinates of each target keyword displayed in the jump interface of the intelligent terminal, randomly selects a position coordinate, calculates the distance value between the selected position coordinate and the position coordinates corresponding to each target keyword that is not selected by using the distance formula between two points, and based on the calculation result, selectively connects the selected position coordinate with the position coordinates corresponding to each target keyword that is not selected by using a line segment;

[0101] The discrete coefficient prediction unit predicts the discrete coefficient of each target keyword displayed in the jump interface according to the connection result of the connection processing unit;

[0102] The cursor drop height prediction unit receives the prediction result transmitted by the discrete coefficient prediction unit, and predicts the cursor drop height based on the received information;

[0103] The AI ​​intelligent peripheral device management module determines the scrolling distance of the roller set on the AI ​​intelligent peripheral device according to the constructed prediction model, and the AI ​​intelligent peripheral device controls the roller to move according to the determined scrolling distance.

[0104] Example 1: Assume that there are 4 target keywords displayed in the jump interface of the smart terminal, and the position coordinates of the 4 target keywords are , , and , randomly select a location coordinate ,but:

[0105] but and The distance between them is: ;

[0106] and The distance between them is: ;

[0107] and The distance between them is: ;

[0108] according to It can be seen that the minimum value is , according to the minimum value 2, the position coordinates of the target keywords that were not selected To obtain, use the line segment to select the position coordinates With position coordinates Perform connection processing;

[0109] Similarly, use the line segment to select the position coordinates With position coordinates Connect the selected position coordinates using line segments and To connect, is the last selected position coordinate, so use line segments to select the selected position coordinates With position coordinates , , Perform connection processing;

[0110] Then the discrete coefficient of the target keyword numbered 3 displayed in the jump interface is:

[0111] ;

[0112] Among them, the connection edges between the target keywords connected to the target keyword numbered 3 are: - and - ;

[0113] The discrete coefficient of the target keyword numbered 3 displayed in the jump interface is .

[0114] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0115] Finally, it should be noted that the above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art can still modify the technical solutions described in the aforementioned embodiments or replace some of the technical features therein by equivalents. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. An AI intelligent peripheral device management method based on the Internet of Things, characterized by: The method comprises: S10: A microphone, a sensor, and a micro camera are placed in the AI ​​smart peripheral device. After the user authorizes, the microphone recognizes the voice command input by the user, and the micro camera collects the display content in the display screen of the smart terminal connected to the AI ​​smart peripheral device. Based on the collected information, the hovering index of the AI ​​smart peripheral device at each cursor hovering position is predicted; The S10 includes: S101: After the user authorizes, the microphone recognizes the voice command input by the user, and the AI ​​intelligent peripheral device controls the intelligent terminal to perform corresponding operations according to the recognized voice command. After the intelligent terminal enters the target interface, the micro camera collects the display content on the display screen of the intelligent terminal; S102: According to the voice command recognized by the microphone, the target content and target keyword that the user is looking for are determined, a plane coordinate system is constructed with the upper left corner of the display screen as the coordinate origin, the horizontal right direction from the coordinate origin is set as the positive direction of the X axis, and the horizontal downward direction from the coordinate origin is set as the positive direction of the Y axis, the position coordinates of each target keyword displayed in the target interface are obtained, the first word position of the title where the target keyword is located is used as the cursor hovering position, and the hovering index of each cursor hovering position is predicted. The specific prediction method is: According to the formula The matching degree between the title content of each title displayed in the target interface and the target content sought by the user is calculated, where i=1,2,…,m, represents the number corresponding to each title displayed in the target interface, and m represents the total number of titles in the target interface. Indicates the number of times the target keyword appears in the title numbered i. Indicates the degree of match between the title content of the title numbered i and the target content that the user is looking for; The distance between the cursor position numbered i and the cursor initial hovering position is calculated using the distance formula between two points. Perform calculations; according to The hover index of each cursor hover position is predicted, where: The hover index of the cursor position numbered i; S20: Based on the predicted hovering index and the user operation gestures collected by the sensor, the operation command of the AI ​​intelligent peripheral device at the next moment is predicted; The S20 includes: S201: determining a movement trajectory of the cursor according to the predicted hover index, and the AI ​​intelligent peripheral device controls the cursor to move according to the determined movement trajectory. During the movement of the cursor, the sensor collects the user's operation gestures, and the operation gestures include clicking and sliding; S202: numbering each operation gesture according to the collection time sequence of the operation gestures, and the numbering result is: j=1,2,…,n, where n represents the total number, based on the collection time of each operation gesture , and the standard moving speed v of the cursor, the position coordinates of the offset point of the moving track are determined. The specific determination method is: according to The distance value between the moving trajectory offset point and the initial hovering position of the cursor is calculated. In the moving trajectory, the distance value between each trajectory point and the initial hovering position of the cursor is obtained. When the obtained distance value is equal to L, the corresponding trajectory point is the moving trajectory offset point, and the position coordinates of the moving trajectory offset point are the position coordinates of the corresponding trajectory point in the coordinate system; S203: predicting the operation instruction of the AI ​​intelligent peripheral device at the next moment according to the collected user operation gestures. The specific prediction method is as follows: Ⅰ. When the user's operation gesture at the offset point of the moving track is a click, the operation instruction of the AI ​​smart peripheral device at the next moment is a pull-down operation; Ⅱ. When the user's operation gesture at the offset point of the moving track is sliding, the moving track of the cursor is adjusted according to the sliding direction and sliding range of the operation gesture. The specific adjustment method is as follows: According to the sliding range of the operation gesture, the moving distance R of the cursor is determined. , if the sliding direction of the user's operation gesture is vertically upward, the position coordinates of the cursor when it stops moving are , if the sliding direction of the user's gesture is vertically downward, the position coordinates of the cursor when it stops moving are , remove the cursor hovering position within the sliding range of the operation gesture, and remove the distance between the cursor stop position according to the distance formula between two points. Calculate, connect each cursor hovering position with a line segment in order of distance values ​​from small to large, connect the cursor hovering position and the cursor stop position corresponding to minT with a line segment, and obtain the adjusted motion trajectory, where min represents the minimum value symbol; in, Indicates the sliding distance value of the operation gesture numbered j, E indicates the maximum sliding distance allowed by the AI ​​smart peripheral device at a time, and H indicates the distance the cursor moves at the maximum sliding distance. is the position coordinate of the offset point of the moving trajectory; III. When the cursor is at the cursor stop position, the AI ​​intelligent peripheral device controls the cursor to move according to the adjusted moving trajectory. At the same time, the sensor collects the user's operation gesture and repeats the operations of I and II in S202 and S203 until the user's operation gesture at the offset point of the moving trajectory is a click; S30: When the AI ​​intelligent peripheral device executes the predicted operation instruction, the micro camera collects the display content in the jump interface of the intelligent terminal, and predicts the drop-down height of the cursor based on the collected information; The S30 includes: The position coordinates of each target keyword displayed in the smart terminal jump interface are obtained, a position coordinate is randomly selected, and the distance value of the selected position coordinate from the position coordinates corresponding to each target keyword that has not been selected is calculated using the distance formula between two points. Calculate according to min The position coordinates of the target keywords that were not selected are obtained, and the selected position coordinates are connected with the obtained position coordinates by using a line segment. The position coordinates will not participate in the calculation of subsequent distance values ​​after selection. The last selected position coordinates are connected with the position coordinates corresponding to each target keyword that was not selected by using a line segment; Predict the discrete coefficient of each target keyword displayed in the jump interface. The specific calculation formula is: ； Wherein, c=1,2,…,C, represents the number value corresponding to each target keyword displayed in the jump interface, and C represents the total number of target keywords displayed in the jump interface. represents the number of connection edges between target keywords connected to the target keyword numbered c, Indicates the total number of target keywords connected to the target keyword numbered c. represents the discrete coefficient of the target keyword numbered c; In the jump interface, max The position coordinates of the corresponding target keyword are obtained, and the ordinate of the obtained position coordinates is the drop-down height value s of the cursor, where max represents the maximum value symbol; S40: Determine a scrolling distance of a scroll wheel set on the AI ​​smart peripheral device according to the predicted pull-down height; The S40 includes: The scrolling distance of the scroll wheel set on the AI ​​smart peripheral device is determined, and the AI ​​smart peripheral device controls the scroll wheel to move according to the determined scrolling distance.

2. An AI intelligent peripheral device management system based on the Internet of Things applied to the AI ​​intelligent peripheral device management method based on the Internet of Things according to claim 1, characterized in that: The system includes a hover index prediction module, an operation instruction prediction module, a pull-down height prediction module and an AI intelligent peripheral device management module; The hover index prediction module is used to predict the hover index of the AI ​​intelligent peripheral device at each cursor hovering position; The hovering index prediction module includes an information collection unit, a matching degree calculation unit and a hovering index prediction unit; After the user authorizes, the information collection unit recognizes the voice command input by the user through the microphone and collects the display content on the display screen of the smart terminal through the micro camera; The matching degree calculation unit calculates the The matching degree between the title content of each title displayed in the target interface and the target content sought by the user is calculated, where i=1,2,…,m, represents the number corresponding to each title displayed in the target interface, and m represents the total number of titles in the target interface. Indicates the number of times the target keyword appears in the title numbered i. Indicates the degree of match between the title content of the title numbered i and the target content that the user is looking for; The hover index prediction unit calculates the distance between each cursor hovering position and the cursor initial hovering position by using the distance formula between two points, and constructs a prediction formula in combination with the calculation result transmitted by the matching degree calculation unit. The hover index of each cursor hover position is predicted, where: Indicates the hover index of the cursor position numbered i. The hover index refers to the probability of the cursor hovering at the corresponding position. Indicates the distance between the cursor hovering position numbered i (the cursor hovering position numbered i refers to the position of the first letter of the title numbered i) and the initial cursor hovering position calculated by the distance formula between two points; The operation instruction prediction module is used to predict the operation command of the AI ​​intelligent peripheral device at the next moment; The operation instruction prediction module includes a cursor movement trajectory determination unit, a movement trajectory offset point determination unit and an operation command prediction unit; The cursor movement trajectory determination unit determines the movement trajectory of the cursor according to the prediction result transmitted by the hover index prediction unit; When the cursor moves along the determined moving trajectory, the moving trajectory offset point collects the user's operation gestures through the sensor, and numbers each operation gesture according to the collection time sequence of the operation gestures. The numbering result is: j=1,2,...,n, where n represents the total number, based on the collection time sequence of each collected operation gesture. , and the standard moving speed v of the cursor, construct the calculation formula The distance value between the moving trajectory offset point and the initial hovering position of the cursor is calculated. In the moving trajectory, the distance value between each trajectory point and the initial hovering position of the cursor is obtained. When the obtained distance value is equal to L, the corresponding trajectory point is the moving trajectory offset point, and the position coordinates of the moving trajectory offset point are the position coordinates of the corresponding trajectory point in the coordinate system; The operation command prediction unit predicts the operation command of the AI ​​intelligent peripheral device at the next moment according to the user operation gesture collected by the sensor. The specific prediction method is: Ⅰ. When the user's operation gesture at the offset point of the moving track is a click, the operation instruction of the AI ​​smart peripheral device at the next moment is a pull-down operation; Ⅱ. When the user's operation gesture at the offset point of the moving track is sliding, the moving track of the cursor is adjusted according to the sliding direction and sliding range of the operation gesture. The specific adjustment method is as follows: According to the sliding range of the operation gesture, the moving distance R of the cursor is determined. , if the sliding direction of the user's operation gesture is vertically upward, the position coordinates of the cursor when it stops moving are , if the sliding direction of the user's gesture is vertically downward, the position coordinates of the cursor when it stops moving are , remove the cursor hovering position within the sliding range of the operation gesture, and remove the distance between the cursor stop position according to the distance formula between two points. Calculate, connect each cursor hovering position with a line segment in order of distance values ​​from small to large, connect the cursor hovering position and the cursor stop position corresponding to minT with a line segment, and obtain the adjusted motion trajectory, where min represents the minimum value symbol; in, Indicates the sliding distance value of the operation gesture numbered j, E indicates the maximum sliding distance allowed by the AI ​​smart peripheral device at a time, and H indicates the distance the cursor moves at the maximum sliding distance. is the position coordinate of the offset point of the moving trajectory; III. When the cursor is at the cursor stop position, the AI ​​intelligent peripheral device controls the cursor to move according to the adjusted moving trajectory. At the same time, the sensor collects the user's operation gesture and repeats the operations of I and II in S202 and S203 until the user's operation gesture at the offset point of the moving trajectory is a click; The pull-down height prediction module is used to predict the pull-down height of the cursor; The pull-down height prediction module includes a connection processing unit, a discrete coefficient prediction unit and a cursor pull-down height prediction unit; The connection processing unit obtains the position coordinates of each target keyword displayed in the jump interface of the intelligent terminal, randomly selects a position coordinate, calculates the distance value between the selected position coordinate and the position coordinates corresponding to each unselected target keyword by using a distance formula between two points, and based on the calculation result, selectively connects the selected position coordinate with the position coordinates corresponding to each unselected target keyword by using a line segment; The discrete coefficient prediction unit constructs a prediction formula according to the connection result of the connection processing unit. Predict the discrete coefficient of each target keyword displayed in the jump interface, where c=1,2,…,C, represents the number value corresponding to each target keyword displayed in the jump interface, and C represents the total number of target keywords displayed in the jump interface. represents the number of connection edges between target keywords connected to the target keyword numbered c, Indicates the total number of target keywords connected to the target keyword numbered c. Indicates the dispersion coefficient of the target keyword numbered c. The dispersion coefficient refers to the dispersion value of the target keyword numbered c compared with other target keywords in the jump interface; The cursor drop height prediction unit receives the prediction result transmitted by the discrete coefficient prediction unit, and predicts the cursor drop height s based on the received information; The AI ​​intelligent peripheral device management module is used to determine the scrolling distance of the scroll wheel set on the AI ​​intelligent peripheral device; The AI ​​intelligent peripheral device management module is based on the constructed prediction model The scrolling distance of the scroll wheel set on the AI ​​smart peripheral device is determined, and the AI ​​smart peripheral device controls the scroll wheel to move according to the determined scrolling distance.

Images