Intelligent blind person chess implementation method and device based on touch and listening fusion

Abstract

The invention provides an intelligent blind chess implementation method and device based on touch and listening fusion, and relates to the technical field of intelligent auxiliary equipment. The method comprises the steps that output voltage is obtained through a Hall effect sensor arranged in a chessboard, and the types and the positions of chess pieces on the chessboard are obtained according to the output voltage; finger pressure is obtained through a resistance type touch panel circuit arranged in the touch sensing small panel, and chess piece types corresponding to fingers and chess piece positions corresponding to the fingers are obtained according to the finger pressure, the chess piece types on the chessboard and the chess piece positions on the chessboard; the output voltage is converted into a voice signal to be output through a voice prompt module arranged in the chessboard; through an intelligent judgment function module arranged in the chessboard, the legality of movement of the chess pieces is judged according to the output voltage. Relates to chess game equipment designed for the blind, combines touch perception, voice prompt and intelligent judgment functions, and aims to improve the experience of the blind participating in chess activities.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent auxiliary equipment, and in particular to a method and device for realizing intelligent blind chess based on touch-auditory fusion. Background Art

[0002] As society pays more attention to the disabled, the demand for blind people to participate in cultural and entertainment activities is increasing. However, traditional chess games pose great challenges to blind players, mainly in terms of memory of the chess game and accuracy of chess moves. When playing chess, blind people often face problems such as difficulty in identifying the position of chess pieces and difficulty in remembering changes in the chess game, which greatly reduces the gaming experience. Most of the existing blind chess products rely on touch or memory and lack effective auxiliary functions, which makes it difficult for blind players to participate in the game. Although some products use voice prompts, they often cannot meet the needs of blind people in fast games and lack intelligent monitoring and feedback mechanisms. In addition, the design of traditional chessboards has failed to fully consider the actual user experience of blind users. The stability of chess pieces and the accuracy of chess placement often become factors that affect the fluency of the game.

[0003] In this context, it is particularly important to develop an innovative intelligent chess for the blind. This product not only needs to combine touch perception and voice prompt technology to help blind players accurately identify the chess game, but also has an intelligent referee function to monitor the player's chess moves in real time, provide timely voice feedback, and correct possible errors. At present, the research of many scholars has proved the feasibility of related technologies. For example, the pressure-sensitive tactile sensors proposed in the literature (M. Crescentini, SF Syeda and GPGibiino, "Hall-Effect Current Sensors: Principles of Operation and Implementation Techniques," in IEEE Sensors Journal, vol. 22, no. 11, pp.10137-10151, 1 June 1, 2022, doi: 10.1109 / JSEN.2021.3119766.) and the literature (Gu Yihong. Design, application and research of high-precision piezoresistive tactile sensors [J]. Sensor Technology and Applications, 2022, 10(2): 218-226.) can be applied to the recognition of falling pieces with high recognition accuracy; the literature (Y. Zhu, Y. Liu, Y. Sun, Y. Zhang and G. Ding, "Recent Advances in Resistive Sensor Technology for Tactile Perception: A Review," in IEEE Sensors Journal, vol.22, no. 16, pp. 15635-15649, 15 Aug.15, 2022, doi: 10.1109 / JSEN.2022.3179015.) and the literature (Hou Zhengfeng. Research on speech denoising based on binary wavelet transform and Wiener filtering [J]. Signal Processing, 2002, 18(3):4.DOI:10.3969 / j.issn.1003-0530.2002.03.017.) The speech optimization method proposed can effectively improve the sound quality and enhance the gaming experience of blind users. Through these technical means, intelligent blind chess can effectively reduce the difficulty of the game, enhance the participation and fun of the blind, and thus enrich their cultural life. In addition, with the advancement of science and technology, the application of artificial intelligence and sensor technology has provided new possibilities for the innovation of entertainment products for the blind. The research and development of intelligent blind chess can not only meet the blind people's needs for entertainment activities, but also promote society's attention and tolerance for people with disabilities and promote the development of related industries.Therefore, developing an intelligent blind chess product with complete functions and easy operation has important social significance and market potential. Summary of the invention

[0004] In order to solve the technical problems of the existing blind chess game equipment in terms of operational convenience and game experience, the embodiment of the present invention provides an intelligent blind chess implementation method and device based on touch-auditory fusion. It aims to enhance the game participation and fun of blind players through innovative design and technical means. The device combines touch perception, voice prompts and intelligent refereeing functions, which can effectively meet the special needs of blind players in chess games. The technical solution is as follows:

[0005] On the one hand, a method for realizing intelligent blind chess based on touch-auditory fusion is provided, wherein the method is realized by an intelligent blind chess realization device based on touch-auditory fusion, wherein the device comprises a chessboard and a touch sensing board; the method comprises:

[0006] S1. Obtaining an output voltage through a Hall effect sensor disposed inside the chessboard, and obtaining the type and position of chess pieces on the chessboard according to the output voltage.

[0007] S2. Obtain finger pressure through a resistive touch panel circuit disposed inside the touch sensing board, and obtain the chess piece type and chess piece position corresponding to the finger according to the finger pressure, the chess piece type and chess piece position on the chess board.

[0008] S3. The output voltage is converted into a voice signal for output through a voice prompt module arranged inside the chessboard.

[0009] S4. The legality of the chess piece movement is judged according to the output voltage by means of the intelligent referee function module arranged inside the chessboard.

[0010] Optionally, the surface of the chessboard is provided with raised chess position marks, and the bottom of the chess pieces is provided with magnetic components.

[0011] Optionally, in S1, the output voltage is obtained by a Hall effect sensor disposed inside the chessboard, as shown in the following formula (1):

[0012] (1)

[0013] In the formula, Indicates the output voltage, represents the sensitivity of the Hall effect sensor, represents the current of the Hall effect sensor, Indicates zero offset, Indicates current A nonlinear function of Represents the noise voltage.

[0014] Optionally, in S2, the chess piece type and the chess piece position corresponding to the finger are obtained according to the finger pressure, the chess piece type and the chess piece position on the chess board, as shown in the following equations (2) and (3):

[0015] (2)

[0016] (3)

[0017] In the formula, It represents the final voltage output by the resistive touch panel circuit at the point where the finger touches. Indicates the output voltage, represents the total resistance of the resistive touch panel circuit, Represents the resistance of the resistive touch panel circuit at the touch point, Indicates the resistance value of each point of the resistive touch panel circuit. Represents the resistivity of the touch pad sensitive material, Indicates the length of the touch pad sensitive material, Represents the cross-sectional area of ​​the touchpad's sensitive material.

[0018] Optionally, the voice prompt module in S3 includes a voice optimization submodule.

[0019] The operation method of the speech optimization submodule is shown in the following formula (4):

[0020] (4)

[0021] In the formula, represents the transfer function of the Wiener filter, where the parameters represents the frequency variable of the sound signal, represents the expected value, represents the Fourier transform of Gaussian white noise, represents the Fourier transform of pure speech, represents the adjustment parameters of the filter, It is calculated by extracting the power of noisy speech and Gaussian white noise. Represents the tuning parameters of the filter.

[0022] Optionally, the chessboard also includes a personalized function module for providing a variety of options for voice broadcast styles and sound attributes.

[0023] The calculation method of the personalized function module is shown in the following formula (5):

[0024] (5)

[0025] In the formula, represents an all-pole filter, represents the complex frequency domain variable of the output speech, represents the LPC analysis filter, Represents the filter polynomial Number of delayed items, Represents the LPC coefficient.

[0026] Optionally, the chessboard is connected to the touch sensing board, the voice prompt module and the intelligent referee function module through the TM32 single-chip microcomputer.

[0027] On the other hand, a device for realizing intelligent blind chess based on touch-auditory fusion is provided, and the device is applied to a method for realizing intelligent blind chess based on touch-auditory fusion. The device includes a chessboard and a touch sensing board; wherein:

[0028] A chessboard is used to obtain an output voltage through a Hall effect sensor arranged inside the chessboard, and obtain the type and position of chess pieces on the chessboard according to the output voltage; through a voice prompt module arranged inside the chessboard, the output voltage is converted into a voice signal for output; through an intelligent referee function module arranged inside the chessboard, the legality of chess piece movement is judged according to the output voltage.

[0029] The touch sensing board is used to obtain finger pressure through a resistive touch panel circuit arranged inside the touch sensing board, and obtain the chess piece type and chess piece position corresponding to the finger according to the finger pressure, the chess piece type and the chess piece position on the chess board.

[0030] Optionally, the surface of the chessboard is provided with raised chess position marks, and the bottom of the chess pieces is provided with magnetic components.

[0031] Optionally, the output voltage is obtained by a Hall effect sensor disposed inside the chessboard, as shown in the following formula (1):

[0032] (1)

[0033] In the formula, Indicates the output voltage, represents the sensitivity of the Hall effect sensor, represents the current of the Hall effect sensor, Indicates zero offset, Indicates current A nonlinear function of Represents the noise voltage.

[0034] Optionally, the chess piece type and the chess piece position corresponding to the finger are obtained according to the finger pressure, the chess piece type and the chess piece position on the chess board, as shown in the following formulas (2) and (3):

[0035] (2)

[0036] (3)

[0037] In the formula, It represents the final voltage output by the resistive touch panel circuit at the point where the finger touches. Indicates the output voltage, represents the total resistance of the resistive touch panel circuit, Represents the resistance of the resistive touch panel circuit at the touch point, Indicates the resistance value of each point of the resistive touch panel circuit. Represents the resistivity of the touch pad sensitive material, Indicates the length of the touch pad sensitive material, Represents the cross-sectional area of ​​the touchpad's sensitive material.

[0038] Optionally, the voice prompt module includes a voice optimization submodule.

[0039] The operation method of the speech optimization submodule is shown in the following formula (4):

[0040] (4)

[0041] In the formula, represents the transfer function of the Wiener filter, where the parameters represents the frequency variable of the sound signal, represents the expected value, represents the Fourier transform of Gaussian white noise, represents the Fourier transform of pure speech, represents the adjustment parameters of the filter, It is calculated by extracting the power of noisy speech and Gaussian white noise. Represents the tuning parameters of the filter.

[0042] Optionally, the chessboard also includes a personalized function module for providing a variety of options for voice broadcast styles and sound attributes.

[0043] The calculation method of the personalized function module is shown in the following formula (5):

[0044] (5)

[0045] In the formula, represents an all-pole filter, represents the complex frequency domain variable of the output speech, represents the LPC analysis filter, Represents the filter polynomial Number of delayed items, Represents the LPC coefficient.

[0046] Optionally, the chessboard is connected to the touch sensing board, the voice prompt module and the intelligent referee function module through the TM32 single-chip microcomputer.

[0047] The beneficial effects brought about by the technical solution provided by the embodiment of the present invention include at least:

[0048] The present invention proposes an intelligent chess device for the blind. Compared with the existing chess game devices for the blind, the advantage of this method is that the game experience and participation of blind players are significantly improved through the comprehensive application of touch perception, voice prompts and intelligent referees; at the same time, the design of the touch perception board effectively reduces the memory burden of the blind players on the chess game, enabling them to understand and master the rules of the game more easily; in addition, the introduction of the intelligent referee module ensures the fairness of the game process, corrects illegal chess moves in a timely manner, and enhances the interactivity between players and the fluency of the game; finally, the personalized setting function of the device enables players to adjust the voice prompts according to their own needs, further enhancing the user's sense of participation and satisfaction, thereby achieving a more friendly and inclusive game environment. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0050] Figure 1 This is a flow chart of a method for realizing intelligent blind chess based on touch-auditory fusion provided by an embodiment of the present invention;

[0051] Figure 2 This is a general implementation flow chart of the intelligent blind chess system provided by an embodiment of the present invention;

[0052] Figure 3 This is a conceptual diagram of a chess piece integrated magnet provided by an embodiment of the present invention;

[0053] Figure 4 It is a pseudo code diagram of the voice broadcast module provided by an embodiment of the present invention;

[0054] Figure 5 This is a pseudo code example diagram of a chess piece movement legality judgment function provided by an embodiment of the present invention;

[0055] Figure 6 The present invention provides a block diagram of an intelligent blind chess implementation device based on touch-auditory fusion. DETAILED DESCRIPTION

[0056] The technical solution of the present invention is described below in conjunction with the accompanying drawings.

[0057] In the embodiments of the present invention, words such as "exemplarily" and "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "example" in the present invention should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of the word "example" is intended to present the concept in a specific way. In addition, in the embodiments of the present invention, the meaning expressed by "and / or" can be both, or it can be either of the two.

[0058] In the embodiments of the present invention, "image" and "picture" can sometimes be used interchangeably. It should be noted that when the difference between them is not emphasized, the meanings they intend to express are the same. "of", "corresponding, relevant" and "corresponding" can sometimes be used interchangeably. It should be noted that when the difference between them is not emphasized, the meanings they intend to express are the same.

[0059] In the embodiments of the present invention, sometimes a subscript such as W1 may be written as a non-subscript such as W1. When the difference is not emphasized, the meanings to be expressed are the same.

[0060] In order to make the technical problems, technical solutions and advantages to be solved by the present invention more clear, a detailed description will be given below with reference to the accompanying drawings and specific embodiments.

[0061] The embodiment of the present invention provides a method for realizing intelligent blind chess based on touch-auditory fusion, which can be realized by an intelligent blind chess realization device based on touch-auditory fusion, which includes a chessboard and a touch sensing board. Figure 1 , Figure 2 The flowchart of the method for realizing intelligent blind chess based on touch-auditory fusion is shown in the figure. The processing flow of the method may include the following steps:

[0062] S1. Obtaining an output voltage through a Hall effect sensor disposed inside the chessboard, and obtaining the type and position of chess pieces on the chessboard according to the output voltage.

[0063] In a feasible implementation, the surface of the chessboard is provided with raised chess position marks, and the design incorporates magnetic adsorption technology to ensure the stability and accuracy of the chess pieces during the move.

[0064] like Figure 3 Shown is a conceptual diagram of chess pieces with integrated magnets. A magnetic component is provided at the bottom of the chess piece, which may be a magnet, to ensure the stability of the chess piece on the chessboard and avoid displacement of the chess piece due to touch.

[0065] Specifically, the modified chess piece is connected to a Hall effect sensor disposed inside the chessboard to detect whether the chess piece is on the chessboard. The Hall element calculates the output voltage according to various feedback parameters to determine the chess piece information. The specific operation is as follows:

[0066] (1)

[0067] In the formula, Indicates the output voltage, represents the sensitivity of the Hall effect sensor, represents the current of the Hall effect sensor, Indicates zero offset, Indicates current A nonlinear function of Represents the noise voltage.

[0068] S2. Obtain finger pressure through a resistive touch panel circuit disposed inside the touch sensing board, and obtain the chess piece type and chess piece position corresponding to the finger according to the finger pressure, the chess piece type and chess piece position on the chess board.

[0069] In a feasible implementation, a touch-sensing small board is provided, and the player can identify the type and position of the chess piece in real time by touching the small board, obtain global information, and reduce the memory burden.

[0070] Specifically, a resistive touch panel circuit is written. The touch screen module is mainly controlled by pressure sensing. According to the detected finger pressure and the output voltage in step S1, the type and position of the corresponding chess piece are calculated. The specific data conversion operation is as follows:

[0071] (2)

[0072] (3)

[0073] In the formula, Indicates the final voltage output by the circuit board at the point where the finger touches. This parameter is used to analyze and obtain chess piece type and position information. Indicates the output voltage, Represents the total resistance of the touch screen system, represents the resistance at the touch point, Indicates the resistance value of each point on the circuit board. The value depends on the area, length and resistivity of the material of the point. Represents the resistivity of the touch pad sensitive material, Indicates the length of the touch pad sensitive material, Represents the cross-sectional area of ​​the touchpad's sensitive material.

[0074] The touch sensing board can realize a corresponding circuit response to the part of the touch pad touched by the finger.

[0075] S3. The output voltage is converted into a voice signal for output through a voice prompt module arranged inside the chessboard.

[0076] In a feasible implementation, Figure 4 The following is the pseudo code of the voice broadcast module, which integrates the voice prompt system. The system provides real-time voice feedback based on the player's operation, helping the player understand the current chess game status, chess piece movement and game rules, improving the operability of the game and reducing the difficulty of the game.

[0077] Specifically, based on step S2, Figure 4 The pseudo code processes the output voltage and converts the relevant voice signal for output. The code is implemented in any language. In order to ensure that the blind players receive clear and unambiguous voice, a voice optimization module can also be added to the algorithm. The specific operation is as follows:

[0078] (4)

[0079] In the formula, represents the transfer function of the Wiener filter, which is used to convert noisy speech into filtered speech (denoising), where the parameters is the frequency variable of the sound signal, For noisy speech, Pure voice, is Gaussian white noise, , as well as They are , and The Fourier transform of is the expected value of the corresponding speech signal power spectrum, and After extracting the power, we can calculate , the statistical average of the noise (no-segment) power. and is the adjustment parameter of the filter. When the Wiener filter is applied to the noisy speech signal, and value to obtain better filtering effect.

[0080] S4. The legality of the chess piece movement is judged according to the output voltage by means of the intelligent referee function module arranged inside the chessboard.

[0081] In a feasible implementation, Figure 5The following is a pseudo code example of the chess piece movement legality judgment function. The intelligent referee module is introduced to monitor the movement of chess pieces in real time to ensure the legality of each move. When the player makes an illegal move, the system will issue a voice warning in time to guide the player to make the correct operation.

[0082] Specifically, the position of each chess piece is captured by the output voltage information in step S2, and a data processing unit is designed and implemented to determine the legality of the chess piece movement. The specific implementation principle can be defined as follows: Figure 3 Function judgment, here Python is used as a simple example, where the validate_move function is used to judge the corresponding coordinates of chess pieces according to the voltage value.

[0083] Optionally, the chessboard also includes a personalized function module for providing a variety of options for voice broadcast styles and sound attributes.

[0084] In a feasible implementation, a personalized setting function is provided, and players can adjust the content and frequency of voice prompts according to their own needs to enhance the user experience.

[0085] Specifically, librosa is called to perform sound preprocessing to change the pitch, frequency, and style of the voice. The operation is as follows:

[0086] (5)

[0087] In the formula, represents an all-pole filter, represents the complex frequency domain variable of the output speech, Represents the LPC (Linear Predictive coding) analysis filter, Represents the filter polynomial Number of delayed items, Represents the LPC coefficients, which are used to construct the LSF processor to obtain sound properties.

[0088] Optionally, the chessboard is connected to the touch sensing board, the voice prompt module and the intelligent referee function module through the TM32 single-chip microcomputer.

[0089] In a feasible implementation, touch perception, voice prompts and intelligent refereeing functions are integrated into a unified system, an STM32 microcontroller with sufficient GPIO interfaces and processing capabilities is selected, and the STM32 firmware is loaded to control hardware operations, including processing touch input signals, controlling voice output and running game logic, so that blind players can easily get started and quickly enter the game state.

[0090] Specifically, the STM32 single chip microcomputer can be arranged inside the chessboard, or in other feasible arrangement modes, which are not limited in the present invention.

[0091] Through the above steps, the intelligent chess device for blind people of the present invention can effectively solve the challenges faced by blind players in chess games and provide a friendly and interactive game environment. The intelligent chess for blind people not only enriches the cultural life of the blind, but also promotes the society's attention and tolerance to the disabled group.

[0092] The present invention integrates a chess piece position mapping module, a touch perception module, a voice prompt system, an intelligent referee module and a personalized setting function, can broadcast the chess game status in real time, and detect the finger position of the blind through touch perception and voice feedback, thereby realizing chess interaction and improving the gaming experience of blind players.

[0093] In the embodiment of the present invention, an intelligent chess device for the blind is proposed. Compared with the existing chess game devices for the blind, the advantage of this method is that the game experience and participation of blind players are significantly improved through the comprehensive application of touch perception, voice prompts and intelligent referees; at the same time, the design of the touch perception board effectively reduces the memory burden of the blind players on the chess game, making it easier for them to understand and master the rules of the game; in addition, the introduction of the intelligent referee module ensures the fairness of the game process, corrects illegal chess moves in a timely manner, and enhances the interactivity between players and the fluency of the game; finally, the personalized setting function of the device enables players to adjust the voice prompts according to their own needs, further enhancing the user's sense of participation and satisfaction, thereby achieving a more friendly and inclusive game environment.

[0094] Figure 6 The block diagram of a device for realizing intelligent blind chess based on touch-auditory fusion according to an exemplary embodiment is shown. The device is used for realizing intelligent blind chess based on touch-auditory fusion. Figure 6 , the device includes a chessboard and a touch sensing board. Wherein:

[0095] A chessboard is used to obtain an output voltage through a Hall effect sensor arranged inside the chessboard, and obtain the type and position of chess pieces on the chessboard according to the output voltage; through a voice prompt module arranged inside the chessboard, the output voltage is converted into a voice signal for output; through an intelligent referee function module arranged inside the chessboard, the legality of chess piece movement is judged according to the output voltage.

[0096] The touch sensing board is used to obtain finger pressure through a resistive touch panel circuit arranged inside the touch sensing board, and obtain the chess piece type and chess piece position corresponding to the finger according to the finger pressure, the chess piece type and the chess piece position on the chess board.

[0097] Optionally, the surface of the chessboard is provided with raised chess position marks, and the bottom of the chess pieces is provided with magnetic components.

[0098] Optionally, the output voltage is obtained by a Hall effect sensor disposed inside the chessboard, as shown in the following formula (1):

[0099] (1)

[0100] In the formula, Indicates the output voltage, represents the sensitivity of the Hall effect sensor, represents the current of the Hall effect sensor, Indicates zero offset, Indicates current A nonlinear function of Represents the noise voltage.

[0101] Optionally, the chess piece type and the chess piece position corresponding to the finger are obtained according to the finger pressure, the chess piece type and the chess piece position on the chess board, as shown in the following formulas (2) and (3):

[0102] (2)

[0103] (3)

[0104] In the formula, It represents the final voltage output by the resistive touch panel circuit at the point where the finger touches. Indicates the output voltage, represents the total resistance of the resistive touch panel circuit, Represents the resistance of the resistive touch panel circuit at the touch point, Indicates the resistance value of each point of the resistive touch panel circuit. Represents the resistivity of the touch pad sensitive material, Indicates the length of the touch pad sensitive material, Represents the cross-sectional area of ​​the touchpad's sensitive material.

[0105] Optionally, the voice prompt module includes a voice optimization submodule.

[0106] The operation method of the speech optimization submodule is shown in the following formula (4):

[0107] (4)

[0108] In the formula, represents the transfer function of the Wiener filter, where the parameters represents the frequency variable of the sound signal, represents the expected value, represents the Fourier transform of Gaussian white noise, represents the Fourier transform of pure speech, represents the adjustment parameters of the filter, It is calculated by extracting the power of noisy speech and Gaussian white noise. Represents the tuning parameters of the filter.

[0109] Optionally, the chessboard also includes a personalized function module for providing a variety of options for voice broadcast styles and sound attributes.

[0110] The calculation method of the personalized function module is shown in the following formula (5):

[0111] (5)

[0112] In the formula, represents an all-pole filter, represents the complex frequency domain variable of the output speech, represents the LPC analysis filter, Represents the filter polynomial Number of delayed items, Represents the LPC coefficient.

[0113] Optionally, the chessboard is connected to the touch sensing board, the voice prompt module and the intelligent referee function module through the TM32 single-chip microcomputer.

[0114] In the embodiment of the present invention, an intelligent chess device for the blind is proposed. Compared with the existing chess game devices for the blind, the advantage of this method is that the game experience and participation of blind players are significantly improved through the comprehensive application of touch perception, voice prompts and intelligent referees; at the same time, the design of the touch perception board effectively reduces the memory burden of the blind players on the chess game, making it easier for them to understand and master the rules of the game; in addition, the introduction of the intelligent referee module ensures the fairness of the game process, corrects illegal chess moves in a timely manner, and enhances the interactivity between players and the fluency of the game; finally, the personalized setting function of the device enables players to adjust the voice prompts according to their own needs, further enhancing the user's sense of participation and satisfaction, thereby achieving a more friendly and inclusive game environment.

[0115] The above embodiments can be implemented in whole or in part by software, hardware (such as circuits), firmware or any other combination. When implemented by software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, the process or function described in the embodiment of the present invention is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center by wired (such as infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that contains one or more available media sets. The available medium can be a magnetic medium (for example, a floppy disk, a hard disk, a tape), an optical medium (for example, a DVD), or a semiconductor medium. The semiconductor medium can be a solid-state hard disk.

[0116] It should be understood that the term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. A and B can be singular or plural. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship, but it may also indicate an "and / or" relationship. Please refer to the context for specific understanding.

[0117] In the present invention, "at least one" means one or more, and "plurality" means two or more. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.

[0118] It should be understood that in various embodiments of the present invention, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0119] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0120] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described equipment, devices and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0121] In the several embodiments provided by the present invention, it should be understood that the disclosed devices, apparatuses and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0122] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0123] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0124] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk, and other media that can store program codes.

[0125] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art who is familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims

1. A method for realizing intelligent blind chess based on touch-auditory fusion, characterized in that: The method is implemented by an intelligent blind chess implementation device based on touch-auditory fusion, and the intelligent blind chess implementation device based on touch-auditory fusion includes a chessboard and a touch sensing board; The method comprises: S1, obtaining an output voltage through a Hall effect sensor disposed inside the chessboard, and obtaining the type and position of chess pieces on the chessboard according to the output voltage; S2, obtaining finger pressure through a resistive touch panel circuit disposed inside the touch sensing board, and obtaining the chess piece type and chess piece position corresponding to the finger according to the finger pressure, the chess piece type and chess piece position on the chess board; S3, converting the output voltage into a voice signal for output through a voice prompt module arranged inside the chessboard; S4. The legality of the chess piece movement is judged according to the output voltage by means of an intelligent referee function module arranged inside the chessboard.

2. The method for realizing intelligent blind chess based on touch-auditory fusion according to claim 1 is characterized in that: The surface of the chessboard is provided with raised chess position marks, and the bottom of the chess pieces is provided with magnetic components.

3. The method for realizing intelligent blind chess based on touch-hearing fusion according to claim 1 is characterized in that: The output voltage in S1 is obtained by the Hall effect sensor disposed inside the chessboard, as shown in the following formula (1): （1） In the formula, Indicates the output voltage, represents the sensitivity of the Hall effect sensor, represents the current of the Hall effect sensor, Indicates zero offset, Indicates current A nonlinear function of Represents the noise voltage.

4. The method for realizing intelligent blind chess based on touch-auditory fusion according to claim 1 is characterized in that: The step S2 obtains the chess piece type and the chess piece position corresponding to the finger according to the finger pressure, the chess piece type and the chess piece position on the chess board, as shown in the following equations (2) and (3): （2） （3） In the formula, It represents the final voltage output by the resistive touch panel circuit at the point where the finger touches. Indicates the output voltage, represents the total resistance of the resistive touch panel circuit, Represents the resistance of the resistive touch panel circuit at the touch point, Indicates the resistance value of each point of the resistive touch panel circuit. Represents the resistivity of the touch pad sensitive material, Indicates the length of the touch pad sensitive material, Represents the cross-sectional area of ​​the touchpad's sensitive material.

5. The method for realizing intelligent blind chess based on touch-auditory fusion according to claim 1, characterized in that: The voice prompt module in S3 includes a voice optimization submodule; The operation method of the speech optimization submodule is shown in the following formula (4): （4） In the formula, represents the transfer function of the Wiener filter, where the parameters represents the frequency variable of the sound signal, represents the expected value, represents the Fourier transform of Gaussian white noise, represents the Fourier transform of pure speech, represents the adjustment parameters of the filter, It is calculated by extracting the power of noisy speech and Gaussian white noise. Represents the tuning parameters of the filter.

6. The method for realizing intelligent blind chess based on touch-auditory fusion according to claim 1, characterized in that: The chessboard also includes a personalized function module for providing multiple options for voice broadcast styles and sound attributes; The calculation method of the personalized function module is shown in the following formula (5): （5） In the formula, represents an all-pole filter, represents the complex frequency domain variable of the output speech, represents the LPC analysis filter, Represents the filter polynomial Number of delayed items, Represents the LPC coefficient.

7. The method for realizing intelligent blind chess based on touch-auditory fusion according to claim 1, characterized in that: The chessboard is connected to a touch sensing board, a voice prompt module and an intelligent referee function module through a TM32 single-chip microcomputer.

8. An intelligent blind chess implementation device based on touch-auditory fusion, the intelligent blind chess implementation device based on touch-auditory fusion is used to implement the intelligent blind chess implementation method based on touch-auditory fusion as claimed in any one of claims 1 to 7, characterized in that: The device comprises a chessboard and a touch sensing plate; wherein: The chessboard is used to obtain an output voltage through a Hall effect sensor arranged inside the chessboard, and obtain the type and position of chess pieces on the chessboard according to the output voltage; convert the output voltage into a voice signal for output through a voice prompt module arranged inside the chessboard; and judge the legality of chess piece movement according to the output voltage through an intelligent referee function module arranged inside the chessboard; The touch sensing board is used to obtain finger pressure through a resistive touch panel circuit arranged inside the touch sensing board, and obtain the chess piece type and chess piece position corresponding to the finger according to the finger pressure, the chess piece type and the chess piece position on the chess board.

9. The intelligent blind chess implementation device based on touch-auditory fusion according to claim 8 is characterized in that: The output voltage is obtained by the Hall effect sensor disposed inside the chessboard, as shown in the following formula (1): （1） In the formula, Indicates the output voltage, represents the sensitivity of the Hall effect sensor, represents the current of the Hall effect sensor, Indicates zero offset, Indicates current A nonlinear function of Represents the noise voltage.

10. The intelligent blind chess implementation device based on touch-auditory fusion according to claim 8 is characterized in that: The chess piece type and the chess piece position corresponding to the finger are obtained according to the finger pressure, the chess piece type and the chess piece position on the chess board, as shown in the following formulas (2) and (3): （2） （3） In the formula, It represents the final voltage output by the resistive touch panel circuit at the point where the finger touches. Indicates the output voltage, represents the total resistance of the resistive touch panel circuit, Represents the resistance of the resistive touch panel circuit at the touch point, Indicates the resistance value of each point of the resistive touch panel circuit. Represents the resistivity of the touch pad sensitive material, Indicates the length of the touch pad sensitive material, Represents the cross-sectional area of ​​the touchpad's sensitive material.

Images