Display device and chess interaction method thereof

Abstract

The invention relates to the technical field of display equipment, in particular to display equipment and a chess interaction method thereof. The method comprises the following steps: performing chess playing analysis according to a first chess piece falling coordinate of a target chess piece in a target chessboard to obtain a second chess piece falling coordinate for the target chess piece; wherein the chess piece falling time of the target chess piece is later than the chess piece falling time of other chess pieces in the target chessboard; according to a first mapping matrix between a ray machine coordinate system corresponding to the projection equipment and a chessboard coordinate system of the target chessboard, converting the second chessboard coordinate into a rendering chessboard coordinate under the ray machine coordinate system; and performing virtual chess piece projection in the target chessboard based on the rendered chess piece placing coordinates through projection equipment. According to the method and the device, a new audio-visual effect is brought to chess sports under the condition of ensuring the operation habits of the chess sports of the user, so that the user can realize chess playing aiming at the chess through the virtual chess pieces in the target chessboard, the user does not need to pay extra learning cost, and the playing experience of the user is improved.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular, to a display device and a chess movement interaction method thereof. Background Art

[0002] Chess movements are widely welcomed because they stimulate logical thinking and creativity.

[0003] With the development of modern technology, the interaction methods of chess movements have become increasingly diverse. For example, virtual chess battles on the Internet and the combination of virtual and real chess interactions using AR technology.

[0004] However, whether it is a virtual chess duel on the Internet or a virtual-real combined AR chess interaction, users need to pay a certain learning cost for game triggering and operation methods. This also increases the access threshold of chess movements, is not conducive to the user experience, and increases the interaction difficulty of chess movements. Summary of the Invention

[0005] The present application provides a display device and a chess movement interaction method thereof, realizing chess game interaction with low learning cost, preventing the access threshold of chess movements from being too high, resulting in some users being unable to effectively carry out chess interactions; reducing the interaction difficulty of chess movements and ensuring that the user experience is not affected.

[0006] In a first aspect, some embodiments provide a display device, including: a display, a communication device, and a controller. Among them, the display is configured to display a user interface; the communication device is configured to establish a communication connection with a server; the controller is configured to:

[0007] Perform a game analysis based on the first dropping coordinate of the target chess piece in the target chessboard to obtain the second dropping coordinate for the target chess piece; wherein, the dropping time of the target chess piece is later than the dropping times of the remaining chess pieces in the target chessboard;

[0008] According to the first mapping matrix between the optical machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard, transform the second dropping coordinate into a rendering dropping coordinate in the optical machine coordinate system;

[0009] Through the projection device, perform virtual chess piece projection in the target chessboard based on the rendering dropping coordinate.

[0010] In some embodiments, according to the first landing coordinate of the target chess piece in the target chessboard, a second landing coordinate for the target chess piece is generated, and according to the first mapping matrix between the optical machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard, the second landing coordinate is transformed into the rendering landing coordinate in the optical machine coordinate system. Furthermore, through the projection device, a virtual chess piece is projected in the target chessboard based on the rendering landing coordinate. According to the above content, it can be seen that during the process of chess movement interaction in this application, by analyzing the first landing coordinate of the target chess piece in the target chessboard, a second landing coordinate for the target chess piece is obtained, achieving the purpose of playing chess with the user; moreover, through the first mapping matrix between the optical machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard, the virtual chess piece is directly projected on the target chessboard, bringing a new audio-visual effect to the chess movement while ensuring the user's chess movement operation habits, enabling the user to play chess through the virtual chess piece in the target chessboard without the user having to pay additional learning costs and improving the user's playing experience.

[0011] In a second aspect, in some embodiments, a method for chess movement interaction is further provided. The controller includes:

[0012] Perform a chess-playing analysis based on the first landing coordinate of the target chess piece in the target chessboard to obtain a second landing coordinate for the target chess piece; wherein, the landing time of the target chess piece is later than the landing times of the other chess pieces in the target chessboard;

[0013] According to the first mapping matrix between the optical machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard, transform the second landing coordinate into the rendering landing coordinate in the optical machine coordinate system;

[0014] Through the projection device, project a virtual chess piece in the target chessboard based on the rendering landing coordinate.

[0015] In some embodiments, according to the first placement coordinate of the target piece in the target chessboard, a second placement coordinate for the target piece is generated, and according to the first mapping matrix between the optical machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard, the second placement coordinate is transformed into a rendering placement coordinate in the optical machine coordinate system. Furthermore, through the projection device, a virtual piece is projected in the target chessboard based on the rendering placement coordinate. According to the above content, it can be seen that during the process of chess movement interaction in this application, by analyzing the first placement coordinate of the target piece in the target chessboard, a second placement coordinate for the target piece is obtained, achieving the purpose of playing against the user; and through the first mapping matrix between the optical machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard, the virtual piece is directly projected on the target chessboard, bringing new audio-visual effects to the chess movement while ensuring the user's chess movement operation habits, enabling the user to play chess against the virtual piece in the target chessboard without the user having to pay additional learning costs and enhancing the user's playing experience.

[0016] In a third aspect, some embodiments also provide a chess movement interaction device, including:

[0017] An analysis module, configured to perform a game analysis based on the first placement coordinate of the target piece in the target chessboard to obtain a second placement coordinate for the target piece; wherein, the placement time of the target piece is later than the placement times of the remaining pieces in the target chessboard;

[0018] A transformation module, configured to transform the second placement coordinate into a rendering placement coordinate in the optical machine coordinate system according to the first mapping matrix between the optical machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard;

[0019] A projection module, configured to project a virtual piece in the target chessboard based on the rendering placement coordinate through the projection device.

[0020] The above-mentioned chess - like sports interaction device generates a second placement coordinate for the target chess piece according to the first placement coordinate of the target chess piece in the target chessboard, and transforms the second placement coordinate into a rendering placement coordinate in the light - machine coordinate system according to the first mapping matrix between the light - machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard. Furthermore, through the projection device, a virtual chess piece is projected in the target chessboard based on the rendering placement coordinate. According to the above content, it can be known that during the process of chess - like sports interaction in this application, by analyzing the first placement coordinate of the target chess piece in the target chessboard, the second placement coordinate for the target chess piece is obtained, achieving the purpose of playing against the user; moreover, through the first mapping matrix between the light - machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard, the virtual chess piece is directly projected on the target chessboard, bringing new audio - visual effects to the chess - like sports while ensuring the user's chess - like sports operation habits, enabling the user to play chess against the virtual chess piece in the target chessboard without the user having to pay additional learning costs and improving the user's playing experience.

[0021] In a fourth aspect, some embodiments further provide a computer - readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the following steps are implemented:

[0022] Perform a game analysis based on the first placement coordinate of the target chess piece in the target chessboard to obtain the second placement coordinate for the target chess piece; wherein, the placement time of the target chess piece is later than the placement times of the other chess pieces in the target chessboard;

[0023] Transform the second placement coordinate into a rendering placement coordinate in the light - machine coordinate system according to the first mapping matrix between the light - machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard;

[0024] Through the projection device, project a virtual chess piece in the target chessboard based on the rendering placement coordinate.

[0025] The readable storage medium provided by the above embodiments generates a second landing coordinate for the target chess piece according to the first landing coordinate of the target chess piece in the target chessboard, and converts the second landing coordinate into a rendering landing coordinate in the light machine coordinate system according to the first mapping matrix between the light machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard. Furthermore, through the projection device, a virtual chess piece is projected in the target chessboard based on the rendering landing coordinate. According to the above content, it can be known that during the process of chess movement interaction in this application, the second landing coordinate for the target chess piece is obtained by analyzing the first landing coordinate of the target chess piece in the target chessboard, achieving the purpose of playing chess with the user; moreover, through the first mapping matrix between the light machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard, the virtual chess piece is directly projected on the target chessboard, bringing new audio-visual effects to the chess movement while ensuring the user's chess movement operation habits, enabling the user to play chess through the virtual chess piece in the target chessboard without the user having to pay additional learning costs and improving the user's playing experience.

[0026] In a fifth aspect, some embodiments further provide a computer program product, including a computer program, which when executed by a processor, implements the following steps:

[0027] Perform chess-playing analysis based on the first landing coordinate of the target chess piece in the target chessboard to obtain a second landing coordinate for the target chess piece; wherein, the landing time of the target chess piece is later than the landing times of the other chess pieces in the target chessboard;

[0028] Convert the second landing coordinate into a rendering landing coordinate in the light machine coordinate system according to the first mapping matrix between the light machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard;

[0029] Through the projection device, project a virtual chess piece in the target chessboard based on the rendering landing coordinate.

[0030] The computer program provided in the above embodiments generates a second placement coordinate for a target chess piece according to the first placement coordinate of the target chess piece in the target chessboard, and transforms the second placement coordinate into a rendering placement coordinate in the light machine coordinate system according to the first mapping matrix between the light machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard. Furthermore, through the projection device, a virtual chess piece is projected in the target chessboard based on the rendering placement coordinate. According to the above content, it can be known that in the process of the chess movement interaction of the present application, the second placement coordinate for the target chess piece is obtained by analyzing the first placement coordinate of the target chess piece in the target chessboard, achieving the purpose of playing chess with the user; and through the first mapping matrix between the light machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard, the virtual chess piece is directly projected on the target chessboard, bringing a new audio-visual effect to the chess movement while ensuring the user's chess movement operation habits, enabling the user to play chess through the virtual chess piece in the target chessboard without the user having to pay additional learning costs and improving the user's playing experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present application, and those of ordinary skill in the art can also obtain other drawings without creative efforts based on these drawings.

[0032] Figure 1 It is a schematic diagram of the operation scenario between a display device and a control device provided in some embodiments of the present application;

[0033] Figure 2 It is a schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;

[0034] Figure 3 It is a schematic diagram of the hardware configuration of a control device provided in some embodiments of the present application;

[0035] Figure 4 It is a schematic diagram of the software configuration of a display device provided in some embodiments of the present application;

[0036] Figure 5 It is a schematic flowchart of the first chess movement interaction method provided in some embodiments of the present application;

[0037] Figure 6 It is a schematic flowchart of the second chess movement interaction method provided in some embodiments of the present application;

[0038] Figure 7Schematic diagram of a checkerboard graphic card provided by some embodiments of the present application;

[0039] Figure 8 Schematic diagram of a first checkerboard image provided by some embodiments of the present application;

[0040] Figure 9 Schematic diagram of a second checkerboard image provided by some embodiments of the present application;

[0041] Figure 10 Schematic diagram of the first checkerboard outer contour provided by some embodiments of the present application;

[0042] Figure 11 Schematic diagram of the second checkerboard outer contour provided by some embodiments of the present application;

[0043] Figure 12 Schematic diagram of a key grid corner point provided by some embodiments of the present application;

[0044] Figure 13 Schematic diagram of the flowchart of the third chess movement interaction method provided by some embodiments of the present application;

[0045] Figure 14 Schematic diagram of a checkerboard chess piece image provided by some embodiments of the present application;

[0046] Figure 15 Schematic diagram of detecting a target checkerboard by a Hough circle detection algorithm provided by some embodiments of the present application;

[0047] Figure 16 Schematic diagram of the flowchart of the fourth chess movement interaction method provided by some embodiments of the present application;

[0048] Figure 17 Schematic diagram of the flowchart of the fifth chess movement interaction method provided by some embodiments of the present application;

[0049] Figure 18 Structure block diagram of a chess movement interaction device provided by some embodiments of the present application;

[0050] Figure 19 Internal structure diagram of a computer device in one embodiment. Detailed implementation manners

[0051] The embodiments will be described in detail below, and the examples are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following embodiments do not represent all implementation manners consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application detailed in the claims.

[0052] It should be noted that the brief description of the terms in this application is only for the convenience of understanding the embodiments described hereinafter, rather than intending to limit the embodiments of this application. Unless otherwise specified, these terms should be understood in their ordinary and common meanings.

[0053] In this application, terms such as "first", "second", "third", etc. in the specification, claims and the above-mentioned drawings are used to distinguish similar or like objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that such terms can be interchanged under appropriate circumstances.

[0054] The terms "comprising" and "having" and any variations thereof are intended to cover but not be exclusive of inclusion. For example, a product or device comprising a series of components does not necessarily have to be limited to all the components clearly listed, but may include other components not clearly listed or inherent to these products or devices.

[0055] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or a combination of hardware or / and software code that can perform functions related to the element.

[0056] In the embodiments of this application, the display device 200 generally refers to a device having the capabilities of displaying images and processing data. For example, the display device 200 includes but is not limited to smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0057] Figure 1 This is a schematic diagram of the operation scenario between the display device and the control device provided for some embodiments of this application. As Figure 1 shown, the user can operate the display device 200 through touch operations, the mobile terminal 300, and the control device 100. For example, the control device 100 can be a remote control, a stylus, a gamepad, etc.

[0058] The mobile terminal 300 can be used as a control device for performing human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device for establishing a communication connection with the display device 200 and performing data interaction. In some embodiments, the mobile terminal 300 and the display device 200 can install software applications, and establish connection communication through network communication protocols to achieve the purpose of one-to-one control operations and data communication. It is also possible to transmit the audio and video content displayed on the mobile terminal 300 to the display device 200 to achieve the synchronous display function.

[0059] As Figure 1It is also shown that the display device 200 also communicates with the server 400 through various communication methods. The display device 200 is allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0060] The display device 200 can provide a broadcast receiving television function, and can also additionally provide an intelligent network television function with computer support functions, including but not limited to, network television, smart TV, Internet Protocol Television (IPTV), etc.

[0061] Figure 2 For some embodiments of this application Figure 1 The hardware configuration block diagram of the display device 200 in

[0062] In some embodiments, the display device 200 may include at least one of a tuner demodulator 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0063] In some embodiments, the detector 230 is used to collect signals from the external environment or interact with the outside. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures. Or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0064] In some embodiments, the display 260 includes a display function component for presenting a picture and a driving component for driving image display. The display 260 is used to receive the image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, components of a menu manipulation interface, and a user manipulation UI interface, etc.

[0065] In some embodiments, the communication device 220 is a component for communicating with external devices or the server 400 according to various communication protocol types. The display device 200 can be provided with multiple communication devices 220 according to different supported communication methods. For example, when the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0066] The communication device 220 can establish a communication connection between the display device 200 and an external device or server 400 via a wireless or wired connection. A wired connection can connect the display device 200 to an external device via a data cable, an interface, or other components. A wireless connection can connect the display device 200 to an external device via a wireless signal or wireless network. The display device 200 can establish a connection with an external device directly or indirectly through a gateway, router, or connection device.

[0067] In some embodiments, the controller 250 may include at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processor, and a power processor, and first to nth interfaces for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in a memory. The controller 250 controls the overall operation of the display device 200.

[0068] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0069] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0070] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may further be provided with an external audio output terminal, through which the audio output device may be connected to the display device 200 to output the sound of the display device 200.

[0071] In some embodiments, the user input interface 280 may be configured to receive instructions from a user.

[0072] Figure 3 Some embodiments of this application provide Figure 1 The hardware configuration diagram of the control device in the figure is as follows. Figure 3 As shown, the control device 100 may include: a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0073] The control device 100 is configured to control the display device 200, receive input operation instructions from the user, and convert the operation instructions into instructions recognizable and responsive by the display device 200, acting as an interaction intermediary between the user and the display device 200.

[0074] In some embodiments, the control device 100 can be an intelligent device. For example, the control device 100 can install various applications for controlling the display device 200 according to user needs.

[0075] In some embodiments, as Figure 1 shown, after installing the application for controlling the display device 200, the mobile terminal 300 or other intelligent electronic devices can perform functions similar to those of the control device 100.

[0076] The controller 110 includes a processor 112, a RAM 113, a ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between internal components and the data processing functions between the external and internal.

[0077] Under the control of the controller 110, the communication interface 130 realizes the communication of control signals and data signals with the display device 200. The communication interface 130 can include at least one of a WiFi chip 131, a Bluetooth module 132, an NFC module 133, and other near - field communication modules.

[0078] The user input / output interface 140, where the input interface includes at least one of a microphone 141, a touchpad 142, a sensor 143, a button 144, and other input interfaces.

[0079] In some embodiments, the control device 100 includes at least one of the communication interface 130 and the input / output interface 140. When the communication interface 130 is configured in the control device 100, such as WiFi, Bluetooth, NFC and other modules, the user input instructions can be encoded through the WiFi protocol, or the Bluetooth protocol, or the NFC protocol and sent to the display device 200.

[0080] The memory 190 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0081] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller.

[0082] To facilitate user interaction, in some embodiments, the display device 200 may run an operating system. An operating system is a computer program used to manage and control the hardware and software resources of the display device 200. The operating system may provide a user interface (control the display device), allow the user to interact with the display device 200, and support the running of various application programs.

[0083] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for display devices.

[0084] The operating system can be divided into different modules or layers according to the functions implemented, e.g. Figure 4 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely the application layer (abbreviated as "application layer"), the application framework layer (abbreviated as "framework layer"), the system library layer and the kernel layer.

[0085] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer can host at least one application, which can include built-in window programs, system settings programs, clock programs, and the like, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0086] The framework layer provides applications with an application programming interface (API) and programming framework. The application framework layer includes predefined functions. The application framework layer acts as a processing center, determining the actions taken by applications in the application layer. Through the API, applications can access system resources and services during execution.

[0087] like Figure 4As shown in the figure, in the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc. Among them, the view system can design and implement the interface and interaction of the application. The view system includes lists, grids, text boxes, buttons, etc. The managers include at least one of the following modules: The Activity Manager is used to interact with all the activities running in the system; the Location Manager is used to provide access to the system location service for system services or applications; the PackageManager is used to retrieve various information related to the application packages currently installed on the device; the NotificationManager is used to control the display and clearing of notification messages; the Window Manager is used to manage icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0088] In some embodiments, the Activity Manager is used to manage the life cycles of various applications and the general navigation back function, such as controlling the exit, opening, and back of the application. The Window Manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, taking screenshots, and controlling the display window changes. For example, shrinking the display window, jittering the display, and distorting the display.

[0089] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction libraries included in the system runtime layer, such as C / C++ instruction libraries, to implement the functions that the framework layer is to achieve.

[0090] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, as Figure 4 shown, hardware drivers can be configured in the kernel layer. The drivers included in the kernel layer can be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor drivers (such as fingerprint sensors, temperature sensors, pressure sensors, etc.), and power drivers, etc.

[0091] It should be noted that the above examples are only simple divisions of the functions of the operating system, and do not limit the specific form of the operating system of the display device 200 in the embodiments of the present application. According to factors such as the functions of the display device and the type of the operating system, the number of levels and the specific level types included in the operating system can be in other forms.

[0092] The above embodiments illustrate the hardware / software architecture and function implementation of a display device 200 and other contents. Although the interaction methods of board games are rich and diverse, whether it is a virtual board game duel on the Internet or an AR board game interaction that combines virtual and real, users need to pay a certain learning cost for game triggering and operation methods. This also increases the access threshold of board games, is not conducive to the user experience of playing, and increases the interaction difficulty of board games.

[0093] To overcome the above problems, in some embodiments, the present application provides a display device 200, including a display 260, a communication device 220, and a controller 250. Among them, the display 260 is configured to display a content playback page; the controller 250 is configured to perform a game analysis based on the first placement coordinate of a target chess piece in a target chessboard to obtain a second placement coordinate for the target chess piece; wherein, the placement time of the target chess piece is later than the placement times of the remaining chess pieces in the target chessboard; according to a first mapping matrix between the optical machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard, the second placement coordinate is transformed into a rendering placement coordinate in the optical machine coordinate system; through the projection device, a virtual chess piece is projected in the target chessboard based on the rendering placement coordinate. The controller 250 controls the display 260 to display a captured image of the target chessboard.

[0094] See the attached Figure 5 The board game interaction method shown is applied to the above-mentioned controller 250 and includes:

[0095] S501, perform a game analysis based on the first placement coordinate of a target chess piece in a target chessboard to obtain a second placement coordinate for the target chess piece.

[0096] Wherein, the placement time of the target chess piece is later than the placement times of the remaining chess pieces in the target chessboard.

[0097] It should be noted that when it is necessary to perform a game analysis based on the first placement coordinate of a target chess piece in a target chessboard, the first placement coordinate of the target chess piece in the target chessboard can be obtained in advance; furthermore, according to a preset game strategy, a game analysis is performed to obtain a second placement coordinate for the target chess piece.

[0098] In an embodiment of the present application, when it is necessary to determine the first placement coordinate of a target chess piece on a target chessboard, a first image of the target chessboard before the chess piece is placed and a second image of the target chessboard after the chess piece is placed by the chess player can be obtained. By comparing the differences between each chess piece in the first image and each chess piece in the second image, if a certain chess piece on the target chessboard only appears in the second image and does not appear in the first image, then it can be determined that this chess piece is the target chess piece; then the coordinate of this target chess piece on the target chessboard is the first placement coordinate of the target chess piece.

[0099] In an embodiment of the present application, if the preset chess strategy is to perform chess analysis through a pre-trained artificial intelligence decision system, then when performing chess analysis based on the first placement coordinate of the target chess piece on the target chessboard to obtain the second placement coordinate for the target chess piece, the following content may be included: determining the first placement coordinate of the target chess piece, inputting the first placement coordinate of the target chess piece and the distribution of the remaining chess pieces on the target chessboard into the artificial intelligence decision system, and obtaining the output result of the artificial intelligence decision system, and this output result is the second placement coordinate for the target chess piece.

[0100] S 502, according to the first mapping matrix between the optical machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard, convert the second placement coordinate into the rendering placement coordinate in the optical machine coordinate system.

[0101] It should be noted that when it is necessary to convert the second placement coordinate into the rendering placement coordinate in the optical machine coordinate system, the first mapping matrix matrix corresponding to the first mapping matrix can be obtained, and the second placement coordinate is multiplied by the inverse matrix of the first mapping matrix matrix, and the obtained operation result is the rendering placement coordinate in the optical machine coordinate system.

[0102] In an embodiment of the present application, according to the above content, the calculation formula for the rendering placement coordinate can be determined, and the calculation formula is as follows:

[0103]

[0104] Among them, refers to the second placement coordinate, refers to the rendering placement coordinate; H-1 refers to the inverse matrix of the first mapping matrix matrix.

[0105] S503, through the projection device, perform virtual chess piece projection on the target chessboard based on the rendering placement coordinate.

[0106] It should be noted that after determining the rendering placement coordinate, using rendering technology, through the projection device, perform virtual chess piece projection on the target chessboard based on the rendering placement coordinate.

[0107] The above-mentioned chess movement interaction method generates a second placement coordinate for the target chess piece according to the first placement coordinate of the target chess piece in the target chessboard, and transforms the second placement coordinate into a rendering placement coordinate in the light machine coordinate system according to the first mapping matrix between the light machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard. Furthermore, through the projection device, a virtual chess piece is projected in the target chessboard based on the rendering placement coordinate. According to the above content, it can be seen that during the process of chess movement interaction in this application, the second placement coordinate for the target chess piece is obtained by analyzing the first placement coordinate of the target chess piece in the target chessboard, achieving the purpose of playing chess with the user. Moreover, through the first mapping matrix between the light machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard, the virtual chess piece is directly projected onto the target chessboard, bringing new audio-visual effects to the chess movement while ensuring the user's chess movement operation habits, enabling the user to play chess through the virtual chess piece in the target chessboard without the user having to pay additional learning costs and improving the user's playing experience.

[0108] Based on the technical solutions of the above embodiments, some alternative embodiments are also provided. Specifically, as Figure 6 shown, the determination process of the first mapping matrix between the light machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard may specifically include the following contents:

[0109] S601, obtain a second mapping matrix between the image coordinate system corresponding to the camera in the projection device and the light machine coordinate system.

[0110] It should be noted that when it is necessary to obtain the second mapping matrix between the image coordinate system corresponding to the camera in the projection device and the light machine coordinate system, it may specifically include the following contents: project a chessboard grid card onto the target chessboard by the projection device; collect an image of the target chessboard with the chessboard grid card projected by the camera to obtain a first chessboard image; determine the second mapping matrix between the image coordinate system corresponding to the camera in the projection device and the light machine coordinate system according to the corresponding relationship between the chessboard grid corner points of the target chessboard and the card grid corner points of the chessboard grid card in the first chessboard image.

[0111] In an embodiment of the present application, the chessboard grid card is as Figure 7 shown, and the first chessboard image obtained by projecting the chessboard grid card onto the target chessboard by the projection device and collecting the image of the target chessboard with the chessboard grid card projected by the camera is as Figure 8 shown. Furthermore, the second mapping matrix between the image coordinate system corresponding to the camera in the projection device and the light machine coordinate system is determined according to the corresponding relationship between the chessboard grid corner points of the target chessboard and the card grid corner points of the chessboard grid card in the first chessboard image.

[0112] S602. Obtain the third mapping matrix between the image coordinate system and the chessboard coordinate system.

[0113] It should be noted that when it is necessary to obtain the third mapping matrix between the image coordinate system and the chessboard coordinate system, it may specifically include the following: project a white card onto the target chessboard by a projection device; wherein, the projected white card completely covers the target chessboard; collect an image of the target chessboard with the white card projected thereon by a camera to obtain a second chessboard image; determine the third mapping matrix between the image coordinate system and the chessboard coordinate system according to the corresponding relationship between the card vertices of the white card in the second chessboard image and the key grid corner points of the target chessboard.

[0114] In an embodiment of the present application, the second chessboard image obtained by collecting an image of the target chessboard with the white card projected thereon after projecting the white card onto the target chessboard is as Figure 9 shown. Furthermore, determine the third mapping matrix between the image coordinate system and the chessboard coordinate system according to the corresponding relationship between the card vertices of the white card in the second chessboard image and the key grid corner points of the target chessboard.

[0115] Further, when it is necessary to determine the third mapping matrix between the image coordinate system and the chessboard coordinate system according to the corresponding relationship between the card vertices of the white card in the second chessboard image and the key grid corner points of the target chessboard, it may include the following: convert the image attribute of the second chessboard image from an RGB color space image to an HSV color space image; perform contour recognition on the second chessboard image after the image attribute conversion to obtain the outer contour of the chessboard. Perform key grid corner point recognition on the contour line segment with the largest quadrilateral area in the outer contour of the chessboard to obtain the contour line segment corner points and grid interior corner points among the key grid corner points in the second chessboard image; determine the third mapping matrix between the image coordinate system and the chessboard coordinate system according to the corresponding relationship between the card vertices of the white card in the second chessboard image and the contour line segment corner points and grid interior corner points of the target chessboard.

[0116] Among them, the process of performing contour recognition on the second chessboard image after the image attribute conversion to obtain the outer contour of the chessboard may further include: perform image preprocessing on the second chessboard image after the image attribute conversion to obtain an intermediate chessboard image; wherein, the image preprocessing includes at least one of downsampling, image smoothing, and image enhancement; perform threshold segmentation on the intermediate chessboard image to obtain a target chessboard image after segmenting the target chessboard and the image background; screen the largest contour corresponding to the target chessboard according to the image center of the target chessboard image; perform precise search on the largest contour according to the average gray value and gray value variance of the largest contour to obtain the outer contour of the chessboard.

[0117] In an embodiment of the present application, the image attributes of the second chessboard image are subjected to attribute conversion, from an RGB color space image to an HSV color space image; so that the contrast between the target chessboard and the background is significantly enhanced in the hue and brightness channels, which is beneficial to the detection of the outer contour of the chessboard. And in the brightness channel, the overall gray-scale change is uniform, which is beneficial to the detection and extraction of the texture on the surface of the chessboard; the second chessboard image after the image attribute conversion is subjected to image preprocessing to obtain an intermediate chessboard image; wherein, the image preprocessing includes at least one of downsampling, image smoothing, and image enhancement; the intermediate chessboard image is subjected to threshold segmentation to obtain a target chessboard image after segmenting the target chessboard and the image background; according to the image center of the target chessboard image, the largest contour corresponding to the target chessboard is screened; according to the average gray value and the variance of the gray value of the largest contour, an accurate search is performed on the largest contour to obtain the outer contour of the chessboard.

[0118] Specifically, a ROI region with a fixed size (in this paper, according to the image size and the size of the Go board in the image, an empirical value is selected: 100 pixels) in the central region of the largest contour is determined, and the average gray value gray of this region is statistically calculated mean and the variance of the gray value gray dev , and the threshold range [threshold min , threshold max is selected according to the following formula; furthermore, after image segmentation according to [threshold min , threshold max , the outer contour of the chessboard is obtained.

[0119] Among them, threshold min = gray mean - s * gray dev ; threshold max = gray mean + s * gray dev ; the value of s can be set according to the actual imaging effect, and the general empirical value is between [1, 2.5]. [[ID=**31]]**

[0120] In an embodiment of the present application, burr removal and hole filling processing are performed on the outer contour of the chessboard; using the Hough line algorithm, the outer contour of the Go board is fitted and disassembled into straight line segments; they are classified according to the lines tending to be horizontal and the lines tending to be vertical, and the short line segments are screened out; all the lines are traversed, and the intersection points of each horizontal line and vertical line are calculated respectively; all the intersection points are traversed, and the four intersection points with the largest area are found, and these intersection points represent the four approximate vertices (rough points) of the outer contour of the Go board. The result is as Figure 10As shown in the figure; for the image ROI area enclosed by the four approximate vertices, a homography transformation is performed to transform it into a specified-sized area (the specified area size used in this article is 700 pixel x 700 pixel. Among them, the go grid line interval is 35 pixel). Furthermore, Figure 10 is homographically transformed to Figure 11 . For the Figure 11 after the homography transformation, the Hough line algorithm is used again to extract the chessboard lines, and the contour line segment with the largest quadrilateral area is obtained; the intersection points of the contour line segments with the largest quadrilateral area are determined, and the feature point detection algorithm is used to identify the key grid corner points in the neighborhood near the intersection points. As Figure 12 shown, the red crosses are the corner points of the contour line segments, and the blue crosses are the grid interior corner points searched in the neighborhood of the corner points of the contour line segments. Furthermore, the third mapping matrix between the image coordinate system and the chessboard coordinate system is determined according to the correspondence between the card vertices of the white card in the second chessboard image and the corner points of the contour line segments and the grid interior corner points of the target chessboard.

[0121] S603, perform a relationship transformation on the second mapping matrix and the third mapping matrix to obtain the first mapping matrix between the optical machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard.

[0122] It should be noted that when it is necessary to perform a relationship transformation on the second mapping matrix and the third mapping matrix, the product operation of the second mapping matrix and the inverse matrix of the third mapping matrix can be performed to obtain the first mapping matrix between the optical machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard.

[0123] Specifically, according to the above content, the calculation formula for the first mapping matrix can be obtained, and the calculation formula is as follows:

[0124] H = H2 -1 * H1;

[0125] Among them, H1 refers to the second mapping matrix; H2w 1 refers to the inverse matrix of the third mapping matrix; H refers to the first mapping matrix.

[0126] The above chess game interaction method realizes the process of performing a relationship transformation on the second mapping matrix and the third mapping matrix to obtain the first mapping matrix between the optical machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard by obtaining the second mapping matrix between the image coordinate system and the optical machine coordinate system corresponding to the camera in the projection device and the third mapping matrix between the image coordinate system and the chessboard coordinate system, effectively ensuring the smooth progress of the subsequent coordinate transformation between the optical machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard.

[0127] Based on the technical solutions of the above embodiments, some alternative embodiments are also provided. Specifically, as Figure 13 shown, perform a game analysis based on the first placement coordinate of the target piece in the target chessboard to obtain the second placement coordinate for the target piece. Specifically, it may include the following content:

[0128] S1301, obtain the chessboard piece image corresponding to the target chessboard.

[0129] It should be noted that an external trigger camera preset can be used to obtain an image of the target chessboard, and the chessboard piece image corresponding to the target chessboard is obtained.

[0130] S1302, based on the piece color of the player and the chessboard piece image, obtain the first placement coordinate of the target piece in the target chessboard.

[0131] It should be noted that when it is necessary to obtain the first placement coordinate of the target piece in the target chessboard based on the piece color of the player and the chessboard piece image, it may include the following content: identify at least one candidate piece corresponding to the player in the chessboard piece image according to the piece color of the player; determine the target piece in the target chessboard according to the difference between each candidate piece in the chessboard piece image and each historical piece at the previous placement of the player; obtain the first placement coordinate of the target piece in the target chessboard.

[0132] In one embodiment, to obtain the chessboard piece image corresponding to the target chessboard, as Figure 14 shown, convert the image attribute of the chessboard piece image from a red / green / blue RGB color space image to a hue / saturation / brightness HSV color space image; determine the piece color of the player; and detect the circular pieces in the target chessboard through the Hough circle detection algorithm. As Figure 15 shown, subtract the piece coordinates detected this time from the piece coordinates of the previous move to obtain the incremental piece coordinates this time, that is, the first placement coordinate of the target piece in the target chessboard.

[0133] S1303, perform a game analysis based on the first placement coordinate to obtain the second placement coordinate for the target piece.

[0134] Specifically, determine the first placement coordinate of the target piece, input the first placement coordinate of the target piece and the distribution of the remaining pieces in the target chessboard into the artificial intelligence decision system, and obtain the output result of the artificial intelligence decision system. This output result is the second placement coordinate for the target piece.

[0135] The above-mentioned chess game interaction method obtains the chess piece image of the target chessboard, and obtains the first landing coordinate of the target chess piece in the target chessboard according to the chess piece color of the player and the chess piece image of the chessboard. Furthermore, according to the first landing coordinate, a game analysis is performed to obtain the second landing coordinate for the target chess piece, providing a data basis for subsequent determination of the rendering landing coordinate.

[0136] In one embodiment, as Figure 16 shown, the determination process of the first mapping matrix between the optical machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard may include:

[0137] S1601, project a chessboard grid chart onto the target chessboard according to the projection device.

[0138] S1602, collect an image of the target chessboard projected with the chessboard grid chart through a camera to obtain a first chessboard image.

[0139] S1603, determine the second mapping matrix between the image coordinate system corresponding to the camera in the projection device and the optical machine coordinate system according to the correspondence between the chessboard grid corners of the target chessboard in the first chessboard image and the chart grid corners of the chessboard grid chart.

[0140] S1604, project a white chart onto the target chessboard according to the projection device; wherein, the projected white chart completely covers the target chessboard.

[0141] S1605, collect an image of the target chessboard projected with the white chart through a camera to obtain a second chessboard image.

[0142] S1606, convert the image attribute of the second chessboard image from a red / green / blue RGB color space image to a hue / saturation / brightness HSV color space image.

[0143] S1607, perform image preprocessing on the second chessboard image after the image attribute conversion to obtain an intermediate chessboard image; wherein, the image preprocessing includes at least one of downsampling, image smoothing, and image enhancement.

[0144] S1608, perform threshold segmentation on the intermediate chessboard image to obtain a target chessboard image after segmenting the target chessboard and the image background.

[0145] S1609, screen to obtain the largest contour corresponding to the target chessboard according to the image center of the target chessboard image.

[0146] S1610, perform an accurate search on the largest contour according to the average gray value and gray value variance of the largest contour to obtain the outer contour of the chessboard.

[0147] S1611. Identify the key grid corner points for the contour line segment with the largest quadrilateral area in the outer contour of the chessboard, and obtain the contour line segment corner points and grid interior corner points among the key grid corner points in the second chessboard image.

[0148] S1612. Determine the third mapping matrix between the image coordinate system and the chessboard coordinate system according to the correspondence between the card vertices of the white card in the second chessboard image and the contour line segment corner points and grid interior corner points of the target chessboard.

[0149] S1613. Perform a product operation on the second mapping matrix and the inverse matrix of the third mapping matrix to obtain the first mapping matrix between the optical machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard.

[0150] In one embodiment, as Figure 17 shown, when it is necessary to project virtual chess pieces within the target chessboard based on the rendered placement coordinates, it may include:

[0151] S1701. Obtain the chessboard chess piece image corresponding to the target chessboard.

[0152] S1702. Identify at least one candidate chess piece corresponding to the player in the chessboard chess piece image according to the chess piece color of the player.

[0153] S1703. Determine the target chess piece within the target chessboard according to the difference between each candidate chess piece in the chessboard chess piece image and each historical chess piece when the player made the previous move.

[0154] S1704. Obtain the first placement coordinate of the target chess piece within the target chessboard.

[0155] S1705. Perform a game analysis based on the first placement coordinate to obtain the second placement coordinate for the target chess piece.

[0156] S1706. According to the first mapping matrix between the optical machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard, transform the second placement coordinate into the rendered placement coordinate in the optical machine coordinate system.

[0157] S1707. Through the projection device, project virtual chess pieces within the target chessboard based on the rendered placement coordinates.

[0158] The above-mentioned board game interaction method generates a second placement coordinate for a target piece according to the first placement coordinate of the target piece in the target game board, and transforms the second placement coordinate into a rendering placement coordinate in the light machine coordinate system according to the first mapping matrix between the light machine coordinate system corresponding to the projection device and the game board coordinate system of the target game board. Furthermore, through the projection device, a virtual piece is projected in the target game board based on the rendering placement coordinate. According to the above content, it can be seen that during the process of board game interaction in this application, the second placement coordinate for the target piece is obtained by analyzing the first placement coordinate of the target piece in the target game board, achieving the purpose of playing against the user; moreover, through the first mapping matrix between the light machine coordinate system corresponding to the projection device and the game board coordinate system of the target game board, the virtual piece is directly projected onto the target game board, bringing new visual and auditory effects to the board game while ensuring the user's board game operation habits, enabling the user to play against the board game through the virtual piece in the target game board without the user having to pay additional learning costs and improving the user's playing experience.

[0159] It should be understood that although the steps in the flowcharts involved in the above embodiments are shown in sequence according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless there is a clear indication in this article, the execution of these steps has no strict order limitation, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages. These steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be executed alternately or in turn with at least a part of other steps or steps or stages in other steps.

[0160] Based on the same inventive concept, an embodiment of the present application also provides a board game interaction device for implementing the above-mentioned board game interaction method. The solution provided by this device to solve the problem is similar to the solution described in the above method. Therefore, the specific limitations in one or more embodiments of the board game interaction device provided below can refer to the limitations on the board game interaction method in the above text and will not be repeated here.

[0161] In one embodiment, as Figure 18 shown, a board game interaction device is provided, including: an analysis module 10, a transformation module 20, and a projection module 30, where:

[0162] An analysis module 10 is configured to perform a game analysis based on the first placement coordinates of a target chess piece within a target chessboard to obtain second placement coordinates for the target chess piece; wherein, the placement time of the target chess piece is later than the placement times of the remaining chess pieces within the target chessboard.

[0163] A transformation module 20 is configured to transform the second placement coordinates into rendering placement coordinates in the optical engine coordinate system according to a first mapping matrix between the optical engine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard.

[0164] A projection module 30 is configured to perform virtual chess piece projection within the target chessboard based on the rendering placement coordinates through a projection device.

[0165] In one embodiment, a second mapping matrix between the image coordinate system corresponding to the camera in the projection device and the optical engine coordinate system is obtained;

[0166] A third mapping matrix between the image coordinate system and the chessboard coordinate system is obtained;

[0167] A relationship transformation is performed on the second mapping matrix and the third mapping matrix to obtain a first mapping matrix between the optical engine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard.

[0168] In one embodiment, a chessboard grid chart is projected onto the target chessboard by the projection device;

[0169] The target chessboard with the projected chessboard grid chart is imaged by the camera to obtain a first chessboard image;

[0170] According to the correspondence between the chessboard grid corners of the target chessboard and the chart grid corners of the chessboard grid chart in the first chessboard image, a second mapping matrix between the image coordinate system corresponding to the camera in the projection device and the optical engine coordinate system is determined.

[0171] In one embodiment, a white chart is projected onto the target chessboard by the projection device; wherein, the projected white chart completely covers the target chessboard;

[0172] The target chessboard with the projected white chart is imaged by the camera to obtain a second chessboard image;

[0173] According to the correspondence between the chart vertices of the white chart and the key grid corners of the target chessboard in the second chessboard image, a third mapping matrix between the image coordinate system and the chessboard coordinate system is determined.

[0174] In one embodiment, a product operation is performed on the second mapping matrix and the inverse matrix of the third mapping matrix to obtain a first mapping matrix between the optical engine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard.

[0175] In one embodiment, the image attributes of the second chessboard image are converted from a red / green / blue (RGB) color space image to a hue / saturation / value (HSV) color space image;

[0176] Perform contour recognition on the second chessboard image whose image attributes have been converted to obtain the outer contour of the chessboard.

[0177] Perform key grid corner point recognition on the contour line segment with the largest quadrilateral area in the outer contour of the chessboard to obtain the contour line segment corner points and grid interior corner points among the key grid corner points in the second chessboard image;

[0178] Determine the third mapping matrix between the image coordinate system and the chessboard coordinate system according to the correspondence between the card vertices of the white card in the second chessboard image and the contour line segment corner points and grid interior corner points of the target chessboard.

[0179] In one embodiment, perform image preprocessing on the second chessboard image whose image attributes have been converted to obtain an intermediate chessboard image; wherein, the image preprocessing includes at least one of downsampling, image smoothing, and image enhancement;

[0180] Perform threshold segmentation on the intermediate chessboard image to obtain the target chessboard image after segmenting the target chessboard and the image background;

[0181] According to the image center of the target chessboard image, screen to obtain the largest contour corresponding to the target chessboard;

[0182] Perform precise search on the largest contour according to the average gray value and gray value variance of the largest contour to obtain the outer contour of the chessboard.

[0183] In one embodiment, obtain the chess pieces image corresponding to the target chessboard;

[0184] According to the chess piece color of the player and the chess pieces image of the chessboard, obtain the first placement coordinate of the target chess piece within the target chessboard;

[0185] Perform game analysis according to the first placement coordinate to obtain the second placement coordinate for the target chess piece.

[0186] In one embodiment, identify at least one candidate chess piece corresponding to the player in the chess pieces image of the chessboard according to the chess piece color of the player;

[0187] Determine the target chess piece within the target chessboard according to the difference between each candidate chess piece in the chess pieces image of the chessboard and each historical chess piece when the player made the previous placement;

[0188] Obtain the first placement coordinate of the target chess piece within the target chessboard.

[0189] The above-mentioned board game interactive device generates a second placement coordinate for the target piece according to the first placement coordinate of the target piece in the target chessboard, and transforms the second placement coordinate into a rendering placement coordinate in the light machine coordinate system according to the first mapping matrix between the light machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard. Furthermore, through the projection device, a virtual piece is projected in the target chessboard based on the rendering placement coordinate. According to the above content, it can be known that during the process of board game interaction in this application, the second placement coordinate for the target piece is obtained by analyzing the first placement coordinate of the target piece in the target chessboard, achieving the purpose of playing against the user; and through the first mapping matrix between the light machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard, the virtual piece is directly projected on the target chessboard, bringing a new audio-visual effect to the board game while ensuring the user's board game operation habits, enabling the user to play the board game through the virtual piece in the target chessboard without the user having to pay an additional learning cost, and enhancing the user's gaming experience.

[0190] Each module in the above-mentioned board game interactive device can be implemented in whole or in part by software, hardware, and their combination. Each of the above modules can be embedded in the processor of the computer device in hardware form or be independent of it, or be stored in the memory of the computer device in software form so that the processor can call and execute the operations corresponding to each of the above modules.

[0191] In one embodiment, a computer device is provided. The computer device can be a terminal, and its internal structure diagram can be as Figure 19As shown in the figure. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit, and an input device. Among them, the processor, the memory, and the input / output interface are connected through a system bus, and the communication interface, the display unit, and the input device are connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and external devices. The communication interface of the computer device is used to communicate with external terminals in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, NFC (Near Field Communication), or other technologies. The computer program, when executed by the processor, implements a method for interactive board game. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen. The input device of the computer device can be a touch layer covering the display screen, or a button, a trackball, or a touchpad provided on the housing of the computer device, or an external keyboard, touchpad, or mouse, etc.

[0192] Those skilled in the art can understand that Figure 19 the structure shown in the figure is only a block diagram of some structures related to the solution of this application, and does not constitute a limitation on the computer device to which the solution of this application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine some components, or have different component arrangements.

[0193] The above embodiments only represent several implementation manners of this application, and their descriptions are relatively specific and detailed, but should not be construed as a limitation on the patent scope of this application. It should be noted that for those of ordinary skill in the art, without departing from the concept of this application, several modifications and improvements can still be made, and these all belong to the protection scope of this application. Therefore, the protection scope of this application should be subject to the appended claims.

Claims

1. A display device, characterized in that, Including: A display configured to display a user interface; A communication device configured to establish a communication connection with a server A controller connected to the display and configured to: Perform a game analysis based on the first placement coordinate of a target chess piece in a target chessboard to obtain a second placement coordinate for the target chess piece; wherein, the placement time of the target chess piece is later than the placement times of the remaining chess pieces in the target chessboard; According to a first mapping matrix between the optical machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard, transform the second placement coordinate into a rendered placement coordinate in the optical machine coordinate system; Through the projection device, perform virtual chess piece projection in the target chessboard based on the rendered placement coordinate.

2. The display device according to claim 1, wherein The determination process of the first mapping matrix between the optical machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard is configured to: Obtain a second mapping matrix between the image coordinate system corresponding to the camera in the projection device and the optical machine coordinate system; Obtain a third mapping matrix between the image coordinate system and the chessboard coordinate system; Perform a relationship transformation on the second mapping matrix and the third mapping matrix to obtain the first mapping matrix between the optical machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard.

3. The display device according to claim 2, wherein The obtaining of the second mapping matrix between the image coordinate system corresponding to the camera in the projection device and the optical machine coordinate system is configured to: Project a chessboard grid chart card from the projection device onto the target chessboard; Collect an image of the target chessboard with the chessboard grid chart card projected thereon through the camera to obtain a first chessboard image; Determine the second mapping matrix between the image coordinate system corresponding to the camera in the projection device and the optical machine coordinate system according to the corresponding relationship between the chessboard grid corner points of the target chessboard and the chart grid corner points of the chessboard grid chart card in the first chessboard image.

4. The display device according to claim 2, characterized in that The obtaining of the third mapping matrix between the image coordinate system and the chessboard coordinate system is configured to: Project a white chart card from the projection device onto the target chessboard; wherein, the projected white chart card completely covers the target chessboard; Collect an image of the target chessboard with the white chart card projected thereon through the camera to obtain a second chessboard image; Determine the third mapping matrix between the image coordinate system and the chessboard coordinate system according to the corresponding relationship between the chart vertices of the white chart card and the key grid corner points of the target chessboard in the second chessboard image.

5. The display device according to claim 2, wherein The performing of a relationship transformation on the second mapping matrix and the third mapping matrix to obtain the first mapping matrix between the optical machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard is configured to: Perform a product operation on the second mapping matrix and the inverse matrix of the third mapping matrix to obtain the first mapping matrix between the optical machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard.

6. The display device according to claim 4, wherein The determining of the third mapping matrix between the image coordinate system and the chessboard coordinate system according to the corresponding relationship between the chart vertices of the white chart card and the key grid corner points of the target chessboard in the second chessboard image is configured to: Convert the image attributes of the second chessboard image from a red / green / blue (RGB) color space image to a hue / saturation / value (HSV) color space image; Perform contour recognition on the second chessboard image after the image attribute conversion to obtain the outer contour of the chessboard; Perform key grid corner point recognition on the contour line segment with the largest quadrilateral area in the outer contour of the chessboard to obtain the contour line segment corner points and grid interior corner points among the key grid corner points in the second chessboard image; Determine the third mapping matrix between the image coordinate system and the chessboard coordinate system according to the correspondence between the card vertices of the white card in the second chessboard image and the contour line segment corner points and grid interior corner points of the target chessboard; 7. The display device according to claim 6, characterized in that, The performing contour recognition on the second chessboard image after the image attribute conversion to obtain the outer contour of the chessboard is configured as: Perform image preprocessing on the second chessboard image after the image attribute conversion to obtain an intermediate chessboard image; wherein, the image preprocessing includes at least one of downsampling, image smoothing, and image enhancement; Perform threshold segmentation on the intermediate chessboard image to obtain a target chessboard image after segmenting the target chessboard and the image background; Screen to obtain the largest contour corresponding to the target chessboard according to the image center of the target chessboard image; Perform precise search on the largest contour according to the average gray value and gray value variance of the largest contour to obtain the outer contour of the chessboard; 8. The display device according to claim 1, characterized in that The performing game analysis according to the first dropping coordinate of the target chess piece in the target chessboard to obtain the second dropping coordinate for the target chess piece is configured as: Obtain the chess piece image of the chessboard corresponding to the target chessboard; Obtain the first dropping coordinate of the target chess piece in the target chessboard according to the chess piece color of the player and the chess piece image of the chessboard; Perform game analysis according to the first dropping coordinate to obtain the second dropping coordinate for the target chess piece; 9. The display device according to claim 8, wherein The obtaining the first dropping coordinate of the target chess piece in the target chessboard according to the chess piece color of the player and the chess piece image of the chessboard is configured as: Identify at least one candidate chess piece corresponding to the player in the chess piece image of the chessboard according to the chess piece color of the player; Determine the target chess piece in the target chessboard according to the difference between each candidate chess piece in the chess piece image of the chessboard and each historical chess piece at the time of the player's previous drop; Obtain the first dropping coordinate of the target chess piece in the target chessboard; 10. A method for chess sports interaction, characterized in that, The controller includes: Perform game analysis according to the first dropping coordinate of the target chess piece in the target chessboard to obtain the second dropping coordinate for the target chess piece; wherein, the dropping time of the target chess piece is later than the dropping time of the remaining chess pieces in the target chessboard; Convert the second dropping coordinate to the rendering dropping coordinate in the light machine coordinate system according to the first mapping matrix between the light machine coordinate system corresponding to the projection device and the chessboard coordinate system of the target chessboard; Perform virtual chess piece projection in the target chessboard based on the rendering dropping coordinate through the projection device.

Images