Device intelligent adjustment method and system for data display

Abstract

The present invention relates to the field of device control, and specifically to a device intelligent adjustment method and system for data display, comprising: a label positioning module, a speaker adjustment module, a digital display screen module, a visual matching module and a sensitive control module, wherein the label positioning module is used to identify the user's position and judge the room and the wall, the speaker adjustment module is used to adjust the volume and angle of each speaker, the digital display screen module is used to generate a visual chart and obtain the frequency spectrum characteristics of the target audio, the visual matching module is used to arrange a search list, and the sensitive control module is used to adjust the operation sensitivity. The present invention can provide users with a convenient, diversified and undistorted audio listening experience, allowing users to move freely while listening to audio, and also allowing users to search for audio to be played more finely, providing a more convenient user experience.

Description

Technical Field

[0001] The present invention relates to the field of equipment control technology, and in particular to an equipment intelligent adjustment method and system for data display. Background Art

[0002] Data display audio is a kind of intelligent audio equipment. In addition to the traditional audio functions, it is also equipped with a display screen for displaying audio data and control settings. It can display the currently playing track, cover, audio waveform and other related audio data. Modern digital display audio consists of multiple small speakers and digital display screens. It is usually fixed and equipped with an intelligent control terminal, allowing users to control the audio equipment more conveniently.

[0003] Since the audio equipment is fixed, the output sound also has a fixed volume and direction. If the user leaves the sound output location or enters another room, under the same audio settings, the sound heard will become smaller and the sound center will deviate, causing audio distortion problems. The manual adjustment method is not flexible enough and cannot achieve real-time adjustment.

[0004] In addition, if there are many audios in the speaker's memory, it often takes a long time for users to find the audio they need. The existing technology indexes by classifying the audio names, but this method is not intuitive enough and cannot quickly help users find the audio they need. How to use the digital display screen to quickly retrieve audio is currently a problem that needs to be solved. Summary of the invention

[0005] The purpose of the present invention is to provide a method and system for intelligently adjusting equipment for data display, so as to solve the problems raised in the above-mentioned background technology.

[0006] In order to solve the above technical problems, the present invention provides the following technical solutions: an intelligent adjustment system for data display equipment, comprising: a label positioning module, a speaker adjustment module, a digital display screen module, a visual matching module and a sensitive control module;

[0007] The tag positioning module is used to identify the user's position using short-distance positioning technology, obtain the distance between the user and the speaker and the angle between the user and the speaker playback center, draw the user's movement trajectory within a cycle, and identify the room and wall in the area where the speaker is located based on the user's movement trajectory;

[0008] The speaker adjustment module is used to calculate the actual volume of the sound box according to the user's position before and after the movement of the user when detecting the movement of the user, and to determine the offset of the sound box playback center, and to adjust the volume and angle of each speaker box so that the actual volume of the sound box is inconvenient before and after the user moves, and the playback center matches the user's position;

[0009] The digital display screen module is used to detect that the user is close to the audio screen, increase the brightness of the screen, and visualize the audio on the digital display screen of the audio to generate an adjustable visualization chart. After the user operates the chart, the user's operation point and adjustment amount are identified, and the frequency spectrum characteristics of the target audio are obtained according to the operation point and adjustment amount;

[0010] The visual matching module is used to index the target audio in the database according to the spectral characteristics, calculate the matching degree of each audio in the database, and calculate the matching degree threshold according to the user's historical playback records, and arrange all audios according to the matching degree to form a search list;

[0011] The sensitivity control module is used to determine the user's spectrum preference according to the user's operation signal and playback history, and adjust the operation sensitivity of the audio digital display screen when the user makes adjustments in different areas of the visual audio chart according to the spectrum preference.

[0012] Further, the tag positioning module includes: a signal exchange unit, a trajectory drawing unit and a wall judgment unit;

[0013] The signal exchange unit is used to enable the speaker to collect location information sent by a short-distance positioning device to identify the user's location. The short-distance positioning device includes: Bluetooth, infrared, NFC patch and network communication equipment;

[0014] The trajectory drawing unit is used to draw the user's movement trajectory according to the user positioning situation collected within a cycle;

[0015] The wall determination unit is used to identify rooms and walls within the audio coverage range according to the movement tracks of the user in different periods.

[0016] Furthermore, the speaker adjustment module includes: a sound source fixed point unit and a volume scaling unit;

[0017] The sound source fixed-point unit is used to detect the movement of the user and adjust the angle of each speaker when the user moves so that the audio playback center matches the user's position;

[0018] The volume scaling unit is used to calculate the actual volume of the audio system according to the user's position and the identified room and wall, and adjust the set volume of the audio system so that the calculated actual volume is the same as the initial setting value.

[0019] Further, the digital display screen module includes: an audio visualization unit, an adjustment receiving unit and a spectrum analysis unit;

[0020] The audio visualization unit is used to separate the frequency spectrum distribution of the audio using audio analysis software, and convert the frequency spectrum distribution into a chart and display it on a digital display screen;

[0021] The adjustment receiving unit is used to increase the brightness of the digital display screen after detecting that the user is close to the digital display screen, and receive the user's operation signal on the digital display screen;

[0022] The spectrum analysis unit is used to obtain the spectrum characteristics of the target audio searched by the user according to the user's operation signal on the digital display screen.

[0023] Further, the visual matching module includes: a priority index unit and an audio list unit;

[0024] The priority index unit is used to calculate the matching degree between each audio in the database and the spectrum feature;

[0025] The audio list unit is used to calculate the search matching threshold according to the user's historical playback records, and arrange all audios with matching degrees higher than the threshold according to the matching degrees to form an audio selection sequence.

[0026] Further, the sensitive control module includes: an audio preference unit and an adjustment control unit;

[0027] The audio preference unit is used to determine the user's spectrum preference at different times according to the user's operation signal and playback history;

[0028] The adjustment control unit adjusts the sensitivity of the search visualization chart in different spectrum intervals on the digital display screen according to the user's spectrum preference.

[0029] The device intelligent adjustment method for data display comprises the following steps:

[0030] Step S1. The speaker receives the location information sent by the short-distance positioning device at a preset time interval, obtains the current location of the user, draws the user's movement trajectory within the cycle based on the user's location collected within a cycle, and identifies the inaccessible area within the user's activity range based on the user's movement trajectory within each cycle;

[0031] Step S2. According to the user positioning described in step S1, the user's position movement is detected, and according to the position of the user before and after the movement of the user from the sound system and the size of the inaccessible area between the user and the sound system, the actual volume of the user's position is calculated, and the set volume of the sound system is adjusted so that the actual volume of the sound system before and after the movement remains unchanged;

[0032] Step S3. Analyze the frequency spectrum of the audio file being played using audio analysis software. When it is detected that the user position coincides with the audio screen, a frequency spectrum image is generated on the digital display screen, and the user's operation signal is received;

[0033] Step S4. According to the spectrum image after the user operation in step S3, the spectrum characteristics of the target audio are obtained, and the matching degree between each audio in the database and the spectrum characteristics of the target audio is calculated. At the same time, according to the user's historical playback records, the matching degree threshold is calculated, and all audios with matching degrees higher than the threshold are arranged in descending order according to the matching degree to form an audio selection sequence, which is generated on the screen and automatically played;

[0034] Step S5. Record the spectrum distribution of the target audio, calculate the user's spectrum preference based on all records in one cycle, and set the sensitivity of different segments in the spectrum image based on the user's spectrum preference.

[0035] Further, step S1 includes:

[0036] Step S11. A signal receiving device is set in the smart speaker to collect the user location coordinates sent by a short-distance positioning device every preset time t. The short-distance positioning device includes: Bluetooth, infrared, NFC patch and wireless communication device;

[0037] Step S12. Take n acquisitions as a cycle, where n is a preset value, arrange all acquired coordinate points in chronological order, and draw the movement trajectory of the user in the current cycle;

[0038] Step S13. Obtain the movement trajectories of all users in the historical periods recorded, and superimpose the movement trajectories of all users in the historical periods in the free space to obtain a historical distribution map of the user's movement trajectories;

[0039] Step S14. Use a classification neural network to process the historical distribution map, output convolutional layer features of different parts of the picture, classify the picture according to the convolutional layer features, obtain the probability of the existence of movement trajectories in each part of the picture, mark the part of the picture where the probability of the existence of movement trajectories is lower than a preset probability as an inaccessible area, and obtain the average probability p of the existence of movement trajectories in the inaccessible area.

[0040] The classification neural network is a deep learning model used to classify input data. It is a common application of convolutional neural networks, mainly used for computer vision tasks such as image recognition, target detection, and face recognition. It is a deep network composed of multiple convolutional layers, pooling layers, and fully connected layers. The extracted features are transformed through a series of linear and nonlinear transformations, and finally the probability values ​​of each category are output.

[0041] Further, step S2 includes:

[0042] Step S21. After the user sets the volume in the smart speaker, the position coordinates (x1, y1) of the user when setting the volume and the volume B1 set by the user are recorded;

[0043] Step S22. Detect the user's position coordinates. If the user coordinates detected twice are the same, it is determined that the user has not moved and the current volume is kept unchanged. If the user coordinates detected twice are different, it is determined that the user has moved and the position coordinates (x2, y2) after the user moves are recorded, and go to step S23;

[0044] Step S23. Connect the coordinates (x, y) of the speaker with (x1, y1) to obtain line segment L1, and connect with (x2, y2) to obtain line segment L2. According to the impassable area marked in step S14, calculate the total length d1 of line L1 in the impassable area and the total length d2 of line L2 in the impassable area;

[0045] Step S24. According to the change of the user's position, the set volume of the audio is adjusted so that the actual volume heard by the user remains unchanged before and after the user moves. The adjustment amount is calculated by the following formula:

[0046] ;

[0047] Among them, B2 represents the adjusted volume, and B1 represents the volume set by the user. Represents the distance between coordinates (x,y) and coordinates (x1,y1), represents the distance between the coordinates (x, y) and the coordinates (x2, y2), p represents the average probability of the existence of the moving track in the impassable area obtained in step S14, and lg represents the logarithmic function with base 10;

[0048] Step S25. Adjust the volume of the speaker to B2, and rotate the direction of the speaker so that the speaker port faces the direction of the user, completing this adjustment.

[0049] This step enables the user to hear the same volume at any location in the activity area, thereby providing the user with a convenient, diverse and undistorted audio listening experience, allowing the user to move around without being affected while listening to audio.

[0050] Further, step S3 includes:

[0051] Step S31. Execute a spectrum analysis method on all audio files in the database to obtain a spectrum distribution diagram of the audio files. The spectrum analysis method is as follows:

[0052] The audio file is cut into m segments in time sequence, where m is a preset value, the sound data in each segment is converted into a time domain digital signal, the time domain digital signal is converted into a frequency domain digital signal using a frequency domain transformation tool in an audio processing library, the average frequency of the segment is identified from the obtained frequency domain signal, a plane coordinate system is generated on the digital display screen of the audio system, the horizontal axis represents the segment number, the vertical axis represents the average frequency of the segment, and a frequency spectrum distribution diagram of the audio file is generated;

[0053] Step S32. After detecting that the user's position coordinates coincide with the coordinates of the audio screen, the brightness of the audio screen is increased, and a spectrum distribution diagram of the currently playing audio file is displayed;

[0054] Step S33. When the user needs to switch audio files, the user slides the digital display screen to adjust the average frequency of each segment. After the adjustment is completed, the adjusted segment number and the average frequency of each segment are recorded.

[0055] Further, step S4 includes:

[0056] Step S41: input the frequency spectrum distribution diagram adjusted by the user into the audio database to match the target audio, where the target audio is the audio represented by the adjusted frequency spectrum distribution diagram;

[0057] Step S42: Execute a matching degree calculation method on each audio in the database to obtain a matching degree of each audio relative to the target audio. The matching degree calculation method is as follows:

[0058] The average value of the audio frequency in the target audio is recorded as x0, and the average value of the frequency in the audio to be matched is recorded as y0, and the matching degree is calculated according to the following formula:

[0059] ;

[0060] Where r represents the matching degree of the audio to be matched, m is a preset value, representing the number of segments the audio file is cut into, xi represents the average frequency of the i-th segment in the target audio, and yi represents the average frequency of the i-th segment in the audio to be matched;

[0061] Step S43. Calculate the matching degree of each audio file in the database relative to the target audio according to the method in step S42, and arrange all audio files in descending order of matching degree to form a sequence [R1, R2, ..., Rk], where k represents the number of audio files in the database, and Rk represents the audio file with the kth matching degree;

[0062] Step S44. Calculate the matching threshold re according to the user's historical playback records, wherein the historical playback records include: the number of historical playbacks of each audio in the database and the average matching degree of the audio in the historical audio selection sequence;

[0063] The matching threshold , where r0 represents the average matching degree of the audio in the historical audio selection sequence, rj represents the matching degree of the j-th audio in the database, ZE represents the total number of historical playbacks of all audio in the database, and Zj represents the number of playbacks of the j-th audio in the database;

[0064] Step S45. Filter out all elements in the sequence [R1, R2, ..., Rk] with a matching degree lower than re, form an audio selection sequence, generate it on the screen, and play it automatically in sequence.

[0065] Further, step S5 includes:

[0066] Step S51. Record the spectrum distribution of the target audio in the database, wherein the spectrum distribution includes: segment numbers and average frequencies of each segment;

[0067] Step S52: extract the spectrum distribution of all target audios recorded in a period from the database, obtain the variance of the average frequency corresponding to each segment number according to the average frequency corresponding to the same segment number, and record the variance as the user's spectrum preference within the segment number;

[0068] Step S53: according to the user's spectrum preference in each segment number, the sensitivity of the corresponding segment in the spectrum image is set, so that the user's spectrum preference in each segment number is positively correlated with the sensitivity of the corresponding segment in the spectrum image.

[0069] Compared with the prior art, the beneficial effects achieved by the present invention are:

[0070] 1. The present invention can use device Bluetooth, NFC patches, etc. to locate users, draw room distribution in the surrounding area of ​​the audio system according to the user's movement trajectory and the length of time the user stays in each activity area, adjust the position and volume of the audio system, so that the volume heard by the user remains unchanged at any position in the activity area, and provide users with a convenient, diversified and undistorted audio listening experience, so that users can move around without being affected while listening to audio.

[0071] 2. The present invention can increase the brightness of the screen and display a visual image of the audio being played after detecting that the user is approaching the audio screen. The user can adjust the audio image, and the most suitable audio list is matched according to the user's adjustment amount, providing a more intuitive and user-friendly operation interface, making it more convenient for the user to search for audio, and allowing the user to control the audio equipment more conveniently.

[0072] 3. The present invention can judge the user's spectrum preference according to the user's action trajectory and playback history, adjust the sensitivity of the user's adjustment in different matching areas, and prevent the user from making an abnormal adjustment in the process of adjusting the digital display screen, resulting in the failure of audio search. At the same time, it can also enable the user to search for audio more finely, providing a more convenient user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0073] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0074] Figure 1 It is a schematic diagram of the structure of the intelligent adjustment system for equipment used for data display of the present invention;

[0075] Figure 2 It is a schematic diagram of the steps of the device intelligent adjustment method for data display of the present invention. DETAILED DESCRIPTION

[0076] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0077] See also Figure 1 ,The present invention provides a technical solution: an intelligent adjustment system for equipment used for data display, comprising: a label positioning module, a speaker adjustment module, a digital display screen module, a visual matching module and a sensitive control module;

[0078] The tag positioning module is used to identify the user's position using short-distance positioning technology, obtain the distance between the user and the speaker and the angle between the user and the center of the speaker, draw the user's movement trajectory within a cycle, and identify the room and wall in the area where the speaker is located based on the user's movement trajectory;

[0079] The tag positioning module includes: a signal exchange unit, a trajectory drawing unit and a wall judgment unit;

[0080] The signal exchange unit is used to enable the speaker to collect location information sent by a short-distance positioning device to identify the user's location. The short-distance positioning device includes: Bluetooth, infrared, NFC patch and network communication equipment;

[0081] The trajectory drawing unit is used to draw the user's movement trajectory according to the user positioning situation collected within a cycle;

[0082] The wall determination unit is used to identify rooms and walls within the audio coverage range according to the movement tracks of the user in different periods.

[0083] The speaker adjustment module is used to calculate the actual volume of the sound box according to the user's position before and after the movement of the user when detecting the movement of the user, and to determine the offset of the sound box playback center, and to adjust the volume and angle of each speaker box so that the actual volume of the sound box is inconvenient before and after the user moves, and the playback center matches the user's position;

[0084] The speaker adjustment module includes: a sound source fixed point unit and a volume scaling unit;

[0085] The sound source fixed-point unit is used to detect the movement of the user and adjust the angle of each speaker when the user moves so that the audio playback center matches the user's position;

[0086] The volume scaling unit is used to calculate the actual volume of the audio system according to the user's position and the identified room and wall, and adjust the set volume of the audio system so that the calculated actual volume is the same as the initial setting value.

[0087] The digital display screen module is used to detect that the user is close to the audio screen, increase the brightness of the screen, and visualize the audio on the digital display screen of the audio to generate an adjustable visualization chart. After the user operates the chart, the user's operation point and adjustment amount are identified, and the frequency spectrum characteristics of the target audio are obtained according to the operation point and adjustment amount;

[0088] The digital display screen module includes: an audio visualization unit, an adjustment receiving unit and a spectrum analysis unit;

[0089] The audio visualization unit is used to separate the frequency spectrum distribution of the audio using audio analysis software, and convert the frequency spectrum distribution into a chart and display it on a digital display screen;

[0090] The adjustment receiving unit is used to increase the brightness of the digital display screen after detecting that the user is close to the digital display screen, and receive the user's operation signal on the digital display screen;

[0091] The spectrum analysis unit is used to obtain the spectrum characteristics of the target audio searched by the user according to the user's operation signal on the digital display screen.

[0092] The visual matching module is used to index the target audio in the database according to the spectral characteristics, calculate the matching degree of each audio in the database, and calculate the matching degree threshold according to the user's historical playback records, and arrange all audios according to the matching degree to form a search list;

[0093] The visual matching module includes: a priority index unit and an audio list unit;

[0094] The priority index unit is used to calculate the matching degree between each audio in the database and the spectrum feature;

[0095] The audio list unit is used to calculate the search matching threshold according to the user's historical playback records, and arrange all audios with matching degrees higher than the threshold according to the matching degrees to form an audio selection sequence.

[0096] The sensitivity control module is used to determine the user's spectrum preference according to the user's operation signal and playback history, and adjust the operation sensitivity of the audio digital display screen when the user makes adjustments in different areas of the visual audio chart according to the spectrum preference.

[0097] The sensitive control module includes: an audio preference unit and an adjustment control unit;

[0098] The audio preference unit is used to determine the user's spectrum preference at different times according to the user's operation signal and playback history;

[0099] The adjustment control unit adjusts the sensitivity of the search visualization chart in different spectrum intervals on the digital display screen according to the user's spectrum preference.

[0100] like Figure 2 As shown, the device intelligent adjustment method for data display includes the following steps:

[0101] Step S1. The speaker receives the location information sent by the short-distance positioning device at a preset time interval, obtains the current location of the user, draws the user's movement trajectory within the cycle based on the user's location collected within a cycle, and identifies the inaccessible area within the user's activity range based on the user's movement trajectory within each cycle;

[0102] Step S1 includes:

[0103] Step S11. A signal receiving device is set in the smart speaker to collect the user location coordinates sent by a short-distance positioning device every preset time t. The short-distance positioning device includes: Bluetooth, infrared, NFC patch and wireless communication device;

[0104] Step S12. Take n acquisitions as a cycle, where n is a preset value, arrange all acquired coordinate points in chronological order, and draw the movement trajectory of the user in the current cycle;

[0105] Step S13. Obtain the movement trajectories of all users in the historical periods recorded, and superimpose the movement trajectories of all users in the historical periods in the free space to obtain a historical distribution map of the user's movement trajectories;

[0106] Step S14. Use a classification neural network to process the historical distribution map, output convolutional layer features of different parts of the picture, classify the picture according to the convolutional layer features, obtain the probability of the existence of movement trajectories in each part of the picture, mark the part of the picture where the probability of the existence of movement trajectories is lower than a preset probability as an inaccessible area, and obtain the average probability p of the existence of movement trajectories in the inaccessible area.

[0107] Step S2. According to the user positioning described in step S1, the user's position movement is detected, and according to the position of the user before and after the movement of the user from the sound system and the size of the inaccessible area between the user and the sound system, the actual volume of the user's position is calculated, and the set volume of the sound system is adjusted so that the actual volume of the sound system before and after the movement remains unchanged;

[0108] Step S2 includes:

[0109] Step S21. After the user sets the volume in the smart speaker, the position coordinates (x1, y1) of the user when setting the volume and the volume B1 set by the user are recorded;

[0110] Step S22. Detect the user's position coordinates. If the user coordinates detected twice are the same, it is determined that the user has not moved and the current volume is kept unchanged. If the user coordinates detected twice are different, it is determined that the user has moved and the position coordinates (x2, y2) after the user moves are recorded, and go to step S23;

[0111] Step S23. Connect the coordinates (x, y) of the speaker with (x1, y1) to obtain line segment L1, and connect with (x2, y2) to obtain line segment L2. According to the impassable area marked in step S14, calculate the total length d1 of line L1 in the impassable area and the total length d2 of line L2 in the impassable area;

[0112] Step S24. According to the change of the user's position, the set volume of the audio is adjusted so that the actual volume heard by the user remains unchanged before and after the user moves. The adjustment amount is calculated by the following formula:

[0113] ;

[0114] Among them, B2 represents the adjusted volume, and B1 represents the volume set by the user. Represents the distance between coordinates (x,y) and coordinates (x1,y1), represents the distance between the coordinates (x, y) and the coordinates (x2, y2), p represents the average probability of the existence of the moving track in the impassable area obtained in step S14, and lg represents the logarithmic function with base 10;

[0115] Step S25. Adjust the volume of the speaker to B2, and rotate the direction of the speaker so that the speaker port faces the direction of the user, completing this adjustment.

[0116] Step S3. Analyze the frequency spectrum of the audio file being played using audio analysis software. When it is detected that the user position coincides with the audio screen, a frequency spectrum image is generated on the digital display screen, and the user's operation signal is received;

[0117] Step S3 includes:

[0118] Step S31. Execute a spectrum analysis method on all audio files in the database to obtain a spectrum distribution diagram of the audio files. The spectrum analysis method is as follows:

[0119] The audio file is cut into m segments in time sequence, where m is a preset value, the sound data in each segment is converted into a time domain digital signal, the time domain digital signal is converted into a frequency domain digital signal using a frequency domain transformation tool in an audio processing library, the average frequency of the segment is identified from the obtained frequency domain signal, a plane coordinate system is generated on the digital display screen of the audio system, the horizontal axis represents the segment number, the vertical axis represents the average frequency of the segment, and a frequency spectrum distribution diagram of the audio file is generated;

[0120] Step S32. After detecting that the user's position coordinates coincide with the coordinates of the audio screen, the brightness of the audio screen is increased, and a spectrum distribution diagram of the currently playing audio file is displayed;

[0121] Step S33. When the user needs to switch audio files, the user slides the digital display screen to adjust the average frequency of each segment. After the adjustment is completed, the adjusted segment number and the average frequency of each segment are recorded.

[0122] Step S4. According to the spectrum image after the user operation in step S3, the spectrum characteristics of the target audio are obtained, and the matching degree between each audio in the database and the spectrum characteristics of the target audio is calculated. At the same time, according to the user's historical playback records, the matching degree threshold is calculated, and all audios with matching degrees higher than the threshold are arranged in descending order according to the matching degree to form an audio selection sequence, which is generated on the screen and automatically played;

[0123] Step S4 includes:

[0124] Step S41: input the frequency spectrum distribution diagram adjusted by the user into the audio database to match the target audio, where the target audio is the audio represented by the adjusted frequency spectrum distribution diagram;

[0125] Step S42: Execute a matching degree calculation method on each audio in the database to obtain a matching degree of each audio relative to the target audio. The matching degree calculation method is as follows:

[0126] The average value of the audio frequency in the target audio is recorded as x0, and the average value of the frequency in the audio to be matched is recorded as y0, and the matching degree is calculated according to the following formula:

[0127] ;

[0128] Where r represents the matching degree of the audio to be matched, m is a preset value, representing the number of segments the audio file is cut into, xi represents the average frequency of the i-th segment in the target audio, and yi represents the average frequency of the i-th segment in the audio to be matched;

[0129] Step S43. Calculate the matching degree of each audio file in the database relative to the target audio according to the method in step S42, and arrange all audio files in descending order of matching degree to form a sequence [R1, R2, ..., Rk], where k represents the number of audio files in the database, and Rk represents the audio file with the kth matching degree;

[0130] Step S44. Calculate the matching threshold re according to the user's historical playback records, wherein the historical playback records include: the number of historical playbacks of each audio in the database and the average matching degree of the audio in the historical audio selection sequence;

[0131] The matching threshold , where r0 represents the average matching degree of the audio in the historical audio selection sequence, rj represents the matching degree of the j-th audio in the database, ZE represents the total number of historical playbacks of all audio in the database, and Zj represents the number of playbacks of the j-th audio in the database;

[0132] Step S45. Filter out all elements in the sequence [R1, R2, ..., Rk] with a matching degree lower than re, form an audio selection sequence, generate it on the screen, and play it automatically in sequence.

[0133] Step S5. Record the spectrum distribution of the target audio, calculate the user's spectrum preference based on all records in one cycle, and set the sensitivity of different segments in the spectrum image based on the user's spectrum preference.

[0134] Step S5 includes:

[0135] Step S51. Record the spectrum distribution of the target audio in the database, wherein the spectrum distribution includes: segment numbers and average frequencies of each segment;

[0136] Step S52: extract the spectrum distribution of all target audios recorded in a period from the database, obtain the variance of the average frequency corresponding to each segment number according to the average frequency corresponding to the same segment number, and record the variance as the user's spectrum preference within the segment number;

[0137] Step S53: according to the user's spectrum preference in each segment number, the sensitivity of the corresponding segment in the spectrum image is set, so that the user's spectrum preference in each segment number is positively correlated with the sensitivity of the corresponding segment in the spectrum image.

[0138] Embodiment: There are 3 audio files in the database, and the number of audio segment slices m=5. The average frequencies of the target audio given by the user in the 5 segments are 200HZ, 150HZ, 500HZ, 400HZ and 150HZ respectively. The audio files in the 3 databases are evenly divided into 5 segments, and the average frequency of each of the 5 segments is obtained respectively. The spectrum of the first file is [100HZ, 250HZ, 100HZ, 200HZ, 250HZ], the second file is: [150HZ, 200HZ, 600HZ, 350HZ, 200HZ], and the third file is: [250HZ, 100HZ, 300HZ, 250HZ, 150HZ]. Arranged by matching degree, the obtained selection sequence is [R2, R3, R1]. According to the calculated user matching degree threshold, the first file does not meet the requirements, and the third file and the second file are displayed on the digital display screen in sequence.

[0139] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0140] Finally, it should be noted that the above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art can still modify the technical solutions described in the aforementioned embodiments or replace some of the technical features therein by equivalents. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A method for intelligently adjusting equipment for data display, characterized in that: The method comprises the following steps: Step S1. The speaker receives the location information sent by the short-distance positioning device at a preset time interval, obtains the current location of the user, draws the user's movement trajectory within the cycle based on the user's location collected within a cycle, and identifies the inaccessible area within the user's activity range based on the user's movement trajectory within each cycle; Step S2. According to the user positioning described in step S1, the user's position movement is detected, and according to the position of the user before and after the movement of the user from the sound system and the size of the inaccessible area between the user and the sound system, the actual volume of the user's position is calculated, and the set volume of the sound system is adjusted so that the actual volume of the sound system before and after the movement remains unchanged; Step S3. Analyze the frequency spectrum of the audio file being played using audio analysis software. When it is detected that the user position coincides with the audio screen, a frequency spectrum image is generated on the digital display screen, and the user's operation signal is received; Step S4. According to the spectrum image after the user operation in step S3, the spectrum characteristics of the target audio are obtained, and the matching degree between each audio in the database and the spectrum characteristics of the target audio is calculated. At the same time, according to the user's historical playback records, the matching degree threshold is calculated, and all audios with matching degrees higher than the threshold are arranged in descending order according to the matching degree to form an audio selection sequence, which is generated on the screen and automatically played; Step S5. Record the spectrum distribution of the target audio, calculate the user's spectrum preference based on all records in one cycle, and set the sensitivity of different segments in the spectrum image based on the user's spectrum preference.

2. The device intelligent adjustment method for data display according to claim 1, characterized in that: Step S1 includes: Step S11. A signal receiving device is set in the smart speaker to collect the user location coordinates sent by a short-distance positioning device every preset time t. The short-distance positioning device includes: Bluetooth, infrared, NFC patch and wireless communication device; Step S12. Take n acquisitions as a cycle, where n is a preset value, arrange all acquired coordinate points in chronological order, and draw the movement trajectory of the user in the current cycle; Step S13. Obtain the movement trajectories of all users in the historical periods recorded, and superimpose the movement trajectories of all users in the historical periods in the free space to obtain a historical distribution map of the user's movement trajectories; Step S14. Use a classification neural network to process the historical distribution map, output convolutional layer features of different parts of the picture, classify the picture according to the convolutional layer features, obtain the probability of the existence of movement trajectories in each part of the picture, mark the part of the picture where the probability of the existence of movement trajectories is lower than a preset probability as an inaccessible area, and obtain the average probability of the existence of movement trajectories in the inaccessible area.

3. The device intelligent adjustment method for data display according to claim 2, characterized in that: Step S2 includes: Step S21. After the user sets the volume in the smart speaker, the position coordinates (x1, y1) of the user when setting the volume and the volume B1 set by the user are recorded; Step S22. Detect the user's position coordinates. If the user coordinates detected twice are the same, it is determined that the user has not moved and the current volume is kept unchanged. If the user coordinates detected twice are different, it is determined that the user has moved and the position coordinates (x2, y2) after the user moves are recorded, and go to step S23; Step S23. Connect the coordinates (x, y) of the speaker with (x1, y1) to obtain line segment L1, and connect with (x2, y2) to obtain line segment L2. According to the impassable area marked in step S14, calculate the total length d1 of line L1 in the impassable area and the total length d2 of line L2 in the impassable area; Step S24. According to the change of the user's position, the set volume of the audio is adjusted so that the actual volume heard by the user remains unchanged before and after the user moves. The adjustment amount is calculated by the following formula: ； Among them, B2 represents the adjusted volume, and B1 represents the volume set by the user. Represents the distance between coordinates (x,y) and coordinates (x1,y1), represents the distance between the coordinates (x, y) and the coordinates (x2, y2), p represents the average probability of the existence of the moving track in the impassable area obtained in step S14, and lg represents the logarithmic function with base 10; Step S25. Adjust the volume of the speaker to B2, and rotate the direction of the speaker so that the speaker port faces the direction of the user, completing this adjustment.

4. The device intelligent adjustment method for data display according to claim 3, characterized in that: Step S3 includes: Step S31. Execute a spectrum analysis method on all audio files in the database to obtain a spectrum distribution diagram of the audio files. The spectrum analysis method is as follows: The audio file is cut into m segments in time sequence, where m is a preset value, the sound data in each segment is converted into a time domain digital signal, the time domain digital signal is converted into a frequency domain digital signal using a frequency domain transformation tool in an audio processing library, the average frequency of the segment is identified from the obtained frequency domain signal, a plane coordinate system is generated on the digital display screen of the audio system, the horizontal axis represents the segment number, the vertical axis represents the average frequency of the segment, and a frequency spectrum distribution diagram of the audio file is generated; Step S32. After detecting that the user's position coordinates coincide with the coordinates of the audio screen, the brightness of the audio screen is increased, and a spectrum distribution diagram of the currently playing audio file is displayed; Step S33. When the user needs to switch audio files, the user slides the digital display screen to adjust the average frequency of each segment. After the adjustment is completed, the adjusted segment number and the average frequency of each segment are recorded.

5. The device intelligent adjustment method for data display according to claim 4, characterized in that: Step S4 includes: Step S41: input the frequency spectrum distribution diagram adjusted by the user into the audio database to match the target audio, where the target audio is the audio represented by the adjusted frequency spectrum distribution diagram; Step S42: Execute a matching degree calculation method on each audio in the database to obtain a matching degree of each audio relative to the target audio. The matching degree calculation method is as follows: The average value of the audio frequency in the target audio is recorded as x0, and the average value of the frequency in the audio to be matched is recorded as y0, and the matching degree is calculated according to the following formula: ； Where r represents the matching degree of the audio to be matched, m is a preset value, representing the number of segments the audio file is cut into, xi represents the average frequency of the i-th segment in the target audio, and yi represents the average frequency of the i-th segment in the audio to be matched; Step S43. Calculate the matching degree of each audio file in the database relative to the target audio according to the method in step S42, and arrange all audio files in descending order of matching degree to form a sequence [R1, R2, ..., Rk], where k represents the number of audio files in the database, and Rk represents the audio file with the kth matching degree; Step S44. Calculate the matching threshold re according to the user's historical playback records, wherein the historical playback records include: the number of historical playbacks of each audio in the database and the average matching degree of the audio in the historical audio selection sequence; The matching threshold , where r0 represents the average matching degree of the audio in the historical audio selection sequence, rj represents the matching degree of the j-th audio in the database, ZE represents the total number of historical playbacks of all audio in the database, and Zj represents the number of playbacks of the j-th audio in the database; Step S45. Filter out all elements in the sequence [R1, R2, ..., Rk] with a matching degree lower than re, form an audio selection sequence, generate it on the screen, and play it automatically in sequence; Step S5 includes: Step S51. Record the spectrum distribution of the target audio in the database, wherein the spectrum distribution includes: segment numbers and average frequencies of each segment; Step S52: extract the spectrum distribution of all target audios recorded in a period from the database, obtain the variance of the average frequency corresponding to each segment number according to the average frequency corresponding to the same segment number, and record the variance as the user's spectrum preference within the segment number; Step S53: according to the user's spectrum preference in each segment number, the sensitivity of the corresponding segment in the spectrum image is set, so that the user's spectrum preference in each segment number is positively correlated with the sensitivity of the corresponding segment in the spectrum image.

6. An intelligent adjustment system for equipment used for data display, characterized in that: The system includes the following modules: label positioning module, speaker adjustment module, digital display screen module, visual matching module and sensitive control module; The tag positioning module is used to identify the user's position using short-distance positioning technology, obtain the distance between the user and the speaker and the angle between the user and the speaker playback center, draw the user's movement trajectory within a cycle, and identify the room and wall in the area where the speaker is located based on the user's movement trajectory; The speaker adjustment module is used to calculate the actual volume of the sound box according to the user's position before and after the movement of the user when detecting the movement of the user, and to determine the offset of the sound box playback center, and to adjust the volume and angle of each speaker box so that the actual volume of the sound box is inconvenient before and after the user moves, and the playback center matches the user's position; The digital display screen module is used to detect that the user is close to the audio screen, increase the brightness of the screen, and visualize the audio on the digital display screen of the audio to generate an adjustable visualization chart. After the user operates the chart, the user's operation point and adjustment amount are identified, and the frequency spectrum characteristics of the target audio are obtained according to the operation point and adjustment amount; The visual matching module is used to index the target audio in the database according to the spectral characteristics, calculate the matching degree of each audio in the database, and calculate the matching degree threshold according to the user's historical playback records, and arrange all audios according to the matching degree to form a search list; The sensitivity control module is used to determine the user's spectrum preference according to the user's operation signal and playback history, and adjust the operation sensitivity of the audio digital display screen when the user makes adjustments in different areas of the visual audio chart according to the spectrum preference.

7. The device intelligent adjustment system for data display according to claim 6, characterized in that: The tag positioning module includes: a signal exchange unit, a trajectory drawing unit and a wall judgment unit; The signal exchange unit is used to enable the speaker to collect location information sent by a short-distance positioning device to identify the user's location. The short-distance positioning device includes: Bluetooth, infrared, NFC patch and network communication equipment; The trajectory drawing unit is used to draw the user's movement trajectory according to the user positioning situation collected within a cycle; The wall determination unit is used to identify rooms and walls within the audio coverage range according to the movement tracks of the user in different periods.

8. The device intelligent adjustment system for data display according to claim 7, characterized in that: The speaker adjustment module includes: a sound source fixed point unit and a volume scaling unit; The sound source fixed-point unit is used to detect the movement of the user and adjust the angle of each speaker when the user moves so that the audio playback center matches the user's position; The volume scaling unit is used to calculate the actual volume of the audio system according to the user's position and the identified room and wall, and adjust the set volume of the audio system so that the calculated actual volume is the same as the initial setting value.

9. The device intelligent adjustment system for data display according to claim 8, characterized in that: The digital display screen module includes: an audio visualization unit, an adjustment receiving unit and a spectrum analysis unit; The audio visualization unit is used to separate the frequency spectrum distribution of the audio using audio analysis software, and convert the frequency spectrum distribution into a chart and display it on a digital display screen; The adjustment receiving unit is used to increase the brightness of the digital display screen after detecting that the user is close to the digital display screen, and receive the user's operation signal on the digital display screen; The spectrum analysis unit is used to obtain the spectrum characteristics of the target audio searched by the user according to the user's operation signal on the digital display screen.

10. The device intelligent adjustment system for data display according to claim 9, characterized in that: The visual matching module includes: a priority index unit and an audio list unit; The priority index unit is used to calculate the matching degree between each audio in the database and the spectrum feature; The audio list unit is used to calculate the search matching threshold according to the user's historical playback records, and arrange all audios with matching degrees higher than the threshold according to the matching degrees to form an audio selection sequence; The sensitive control module includes: an audio preference unit and an adjustment control unit; The audio preference unit is used to determine the user's spectrum preference at different times according to the user's operation signal and playback history; The adjustment control unit adjusts the sensitivity of the search visualization chart in different spectrum intervals on the digital display screen according to the user's spectrum preference.

Images