Interaction system, interaction method and learning machine

Abstract

The invention provides an interaction system, an interaction method and a learning machine. In the interactive system, a machine body presents a game picture based on a segment code liquid crystal screen, so that a user executes physical operation on the game picture; in addition, the machine body can also determine physical operation executed by the user for the game picture through sensing information collected by the camera module, update the game picture displayed by the segment code liquid crystal screen according to the physical operation, and determine a game result. Based on the implementation mode, the game picture can be displayed based on the segment code liquid crystal screen instead of being displayed in a printed matter mode, a user can execute physical operation on the segment code liquid crystal screen to participate in the game process, and then a set of complete interaction system is formed. On the premise that hardware of a machine body does not need to be improved, extremely high question richness is contained with extremely low cost, the cost is low, durability is high, eye protection performance is high, and the problems that paper game cards are small in question quantity, prone to being lost and the like are solved.

Description

Technical Field

[0001] The present disclosure relates to the technical field of interactive systems, and in particular, to an interactive system, an interactive method, and a learning machine. Background Art

[0002] In the field of early childhood education, games such as sudoku and mazes are often important ways to complete educational enlightenment. In these games, students' logical thinking ability, cognitive ability, and hands-on ability can be greatly improved.

[0003] In the related art, these games often rely on printed materials for presentation. For example, in the learning cards supporting learning machine products, there may be provided the content of several printed sudoku questions or maze questions. However, the game questions provided in this form are not only very limited in number and easily make students feel bored, but also easily lost. Summary of the Invention

[0004] To overcome the problems existing in the related art, the present disclosure provides an interactive system, an interactive method, and a learning machine.

[0005] The first aspect of the present disclosure provides an interactive system, including a body, a segment LCD screen, and a camera module;

[0006] Wherein, the body is configured to:

[0007] Respond to the selection of a target game, and notify the segment LCD screen to display the game screen corresponding to the target game;

[0008] And obtain the image collected by the camera module;

[0009] And determine the operation result obtained after the user performs an operation on the game screen displayed on the segment LCD screen according to the obtained image;

[0010] And control the scheduling of the target game according to the operation result;

[0011] The segment LCD screen is configured to:

[0012] When receiving the notification sent by the body, display the game screen corresponding to the target game according to the notification;

[0013] And display the corresponding game screen according to the scheduling of the target game by the body;

[0014] The camera module is deployed on the body or independent of the body;

[0015] The camera module is configured to:

[0016] Collect the content of the display area of the segment LCD screen.

[0017] Optionally, the target game includes a board game, and the game screen includes the board of the board game;

[0018] The segment LCD screen includes a plurality of display units, each display unit being composed of a plurality of segments, wherein the plurality of display units respectively correspond to a plurality of piece placement positions of the board game;

[0019] The segment LCD screen is used for:

[0020] By controlling the activation state of each segment in the display unit corresponding to each piece placement position, to represent the piece placed on the piece placement position.

[0021] Optionally, the system further includes pieces, which are used to be placed on the segment LCD screen;

[0022] The operation result includes the user's game board formed by the pieces placed on the segment LCD screen.

[0023] Optionally, at least one surface of the piece is provided with an identification code for identifying the piece, and the body is used to determine the operation result according to the identification code included in the image captured by the camera module, wherein the identification code includes at least one of the following:

[0024] OID identification code, two-dimensional code, text.

[0025] Optionally, the segment LCD screen and the body are of a split structure, the camera module is deployed on the body, and the body is provided with a limiting component, and the segment LCD screen is used to be inserted into the limiting component so that the segment LCD screen is within the field of view angle of the camera module.

[0026] Optionally, the segment LCD screen and the body are of a split structure, the segment LCD screen includes a battery, and the body is used to control the segment LCD screen to display the game screen of the target game based on a wireless connection communication method;

[0027] And / or, the target game includes at least one of a sudoku game, a gobang game, and a go game.

[0028] A second aspect of the present disclosure provides an interaction method, which is applied to the body in the interaction system. The interaction system further includes a segment LCD screen and a camera module. The camera module is deployed on the body or independent of the body;

[0029] The method includes:

[0030] In response to the selection of the target game, notify the segment LCD screen to display the game screen corresponding to the target game;

[0031] Obtain the image collected by the camera module, and determine the operation result obtained after the user performs an operation on the game screen displayed on the segment LCD screen according to the obtained image;

[0032] Control the scheduling of the target game according to the operation result, so that the segment LCD screen displays the corresponding game screen according to the scheduling of the target game by the body.

[0033] Optionally, the controlling the scheduling of the target game according to the operation result includes:

[0034] Determine the game progress of the target game according to the operation result;

[0035] Notify the segment LCD screen to update the game screen corresponding to the target game according to the game progress.

[0036] Optionally, the method further includes:

[0037] Determine whether the user's game process needs to be intervened according to the physical operation performed by the user on the segment LCD screen;

[0038] If the user's game process needs to be intervened, control the segment LCD screen to display intervention information at the target intervention position, where the target game includes a board game, and the target intervention position includes at least one chess piece placement position of the target game.

[0039] A third aspect of the present disclosure provides a learning machine, including a camera module, a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the method described in the second aspect is implemented.

[0040] The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

[0041] In the interaction system provided by the embodiments of the present disclosure, the machine body presents the game screen based on the segmental LCD screen, so that the user can perform physical operations on the game screen; in addition, the machine body can also determine the physical operations performed by the user on the above game screen according to the image information collected by the camera module, and update the game screen displayed on the above segmental LCD screen and determine the game result according to the physical operations. Based on this implementation, the game screen is not limited to being presented in the form of printed matter, but can be presented based on the segmental LCD screen, and the user can also perform physical operations on the segmental LCD screen to participate in the game process, realizing the direct combination of vision and behavior. It can be seen that the system constitutes a complete interaction system, which can accommodate a very high degree of question richness at a very low cost without the need to improve the hardware of the machine body, avoiding problems such as small question quantity, high cost, inconvenient use, and difficult arrangement in the related technology; at the same time, compared with directly using the LCD and OLED screens on mobile phones and tablets, the manufacturing cost, power consumption, and required data transmission bandwidth of the segmental LCD screen are much lower, and the durability is much higher, and it can greatly relieve the user's concern about eye protection, making this solution applicable to mass consumer products.

[0042] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. Brief Description of the Drawings

[0043] The drawings here are incorporated into the specification and constitute a part of the present disclosure, showing embodiments consistent with the present disclosure, and are used together with the specification to explain the principles of the present disclosure.

[0044] Figure 1 It is a schematic diagram of a segmental LCD screen shown in some exemplary embodiments.

[0045] Figure 2 It is a schematic diagram of an interaction system shown in some exemplary embodiments.

[0046] Figure 3 It is a flowchart of an interaction method shown in some exemplary embodiments.

[0047] Figure 4 It is a block diagram of a module of an interaction device shown in some exemplary embodiments.

[0048] Figure 5 It is a hardware structure diagram of a learning machine shown in some exemplary embodiments. Detailed Embodiments

[0049] Exemplary embodiments will be described in detail herein, and examples thereof are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. On the contrary, they are merely examples of an interactive system, an interactive method, a learning machine, and an electronic device consistent with some aspects of the present disclosure as detailed in the appended claims.

[0050] As mentioned in the background art, in the related art, games such as sudoku chess and mazes often rely on printed materials to present. For example, in the learning cards supporting learning machine products, there may be provided several printed sudoku questions or maze question contents. However, the game questions provided in this form are not only very limited in number, easily making students feel bored, but also easily lost.

[0051] In view of this, the present disclosure provides an interactive system, an interactive method, and a learning machine. The embodiments of the present disclosure will be described in detail below.

[0052] In a first aspect of the present disclosure, an interactive system is provided, and the interactive system may include a body, a segment LCD screen, and a sensing module.

[0053] Among them, the segment LCD screen and the sensing module (such as a camera module) are both connected to the body, and the connection method may be wired connection, Bluetooth connection, wireless local area network connection, etc. In addition, these components may be connected by solid-state components to ensure the structural stability between them. In this system, the body can be used for;

[0054] Among them, the body can be used for:

[0055] Responding to the selection of a target game, notifying the segment LCD screen to display the game screen corresponding to the target game; and obtaining the image collected by the camera module; and determining, according to the obtained image, the operation result obtained after the user performs an operation on the game screen displayed on the segment LCD screen; and controlling the scheduling of the target game according to the operation result. The segment LCD screen can be used for: when receiving the notification sent by the body, displaying the game screen corresponding to the target game according to the notification; and displaying the corresponding game screen according to the scheduling of the target game by the body. The camera module is deployed on the body (that is, there is a known pose mapping relationship between it and the body), or is independent of the body; the camera module can be used for: collecting the content of the display area of the segment LCD screen.

[0056] Among them, the body can be an enlightenment device such as a learning machine or a thinking machine, or a computer device such as a personal computer or a mobile phone. It can collect the user's "selection of the target game" through sensors such as a microphone, buttons, a touch screen, and a camera module (i.e., a camera device), and then notify the touch screen to display the content of the game (such as the initial chessboard of a board game). The sensing module can be a camera device deployed on the body (the segmental LCD screen can be placed within the field of view of the camera so that the camera can capture the physical operations performed by the user on the screen), or a touch module (such as a touch layer covering the screen), a pressure sensing module, etc. deployed on the segmental LCD screen. The game screen can be a chessboard (such as a chess endgame, a Sudoku puzzle), or a maze, etc., and its presentation form is not limited (examples will be given later). The physical operation can be pointing a finger at a certain position, clicking on a certain position on the segmental LCD screen, or placing a physical object on the segmental LCD screen. After the operation completed by the user is collected by the sensing module, the body can perform the calculation of the game algorithm and determine whether the game ends (for example, the user has achieved the game goal or whether the game times out), or how to update the picture displayed on the segmental LCD screen (for example, in chess, after the user makes a move as the red side, the body can simulate the black side to make a move and display it on the segmental LCD screen).

[0057] The "selection of the target game" can refer to "the user selects a certain game among multiple preset games", "the user connects the segmental LCD screen corresponding to the preset game to the body", etc. This user instruction can be collected by the body and used to start the target game. The "operation result" can either refer to "a certain physical operation is completed" in the action dimension (for example, the user points a fingertip at a certain position and stays for a preset duration, or the user makes a move in chess), or refer to the entity result formed by the physical operation in the entity dimension (for example, the new chessboard after the user places a certain chess piece on the segmental LCD screen). After these operations are recognized, they can be converted into information in a preset format (this information can represent the global information of the chessboard or the operations performed by the user) as input and input into the algorithm of the target game, so as to achieve compatibility with the original algorithm logic (only the input and output media have changed).

[0058] And "scheduling" can refer to "the result of the game" (that is, inputting the above-mentioned information in the preset format into the algorithm of the target game), such as "no change", "game success", "game failure", "need to update the picture (for example, in a gobang game, after one side completes the action of placing a piece, the other side played by the body can place a piece, then the game picture needs to be updated)", etc. In addition, the above-mentioned body can also be used to control the segmental LCD screen to update the chessboard of the chess game according to the operation result. Details about this will be described later.

[0059] The concepts of segment codes, display units, and segment code liquid crystal displays are introduced below. In a segment code liquid crystal display, the smallest controllable unit of the display system is usually referred to as a segment code. Each segment code generally meets the following conditions: it has a fixed geometric shape (such as a line segment, a point, a polygon, etc.); there is a finite set of states (that is, each segment code has several preset activation states). For example, in a common binary state set, a segment code usually has two states: a sleep state (non-activated state) and an activated state, corresponding to "extinguished" (non-activated state) and "lit" (activated) respectively; the state transition of each segment code is controlled by an external electrical signal; the physical boundaries between different segment codes can be recognized by an observer. Generally speaking, segment codes can exemplarily include the following types: TN (Twisted Nematic), HTN (High-Temperature Twisted Nematic), STN (Super Twisted Nematic), VATN (Vertical Alignment Twisted Nematic).

[0060] Based on the above content, it can be further known that since the geometric shape of the segment code is preset, N (N is a positive integer) segment codes are used to form a display unit. The display unit can present different visual effects (i.e., different display states) by controlling the current extinguished and lit states (i.e., "activation states") of different segment codes inside it. That is, the display unit has a set of visual effects S = {s 1 , s 2 ,..., s n}, and there are 2 N elements in S. The display unit can present any visual effect in S according to the type of external electrical signal. A display device composed of multiple segment codes can be called a segment code liquid crystal display (of course, this is a general term, and the present disclosure does not limit the specific implementation principle of this screen. That is, this screen is not necessarily based on the liquid crystal display principle, and it can also be called a segment code display screen or a segment code screen). A segment code liquid crystal display can include at least one display unit.

[0061] For example, please refer to Figure 1, the display unit shown on the left side thereof is a display unit that displays Arabic numerals through seven segment codes a, b, c, d, e, f, and g. Of course, in addition to Arabic numerals, by controlling the shape and arrangement of the segment codes, it is also possible to achieve the display of Othello (for example, making a solid circle represent a black piece, a hollow circle represent a white piece, and no display indicating no piece at that position), the display of Chinese chess (several radicals forming Chinese characters), etc. Special display effects achieved through dynamic effects (such as controlling the segment codes to flash quickly or light up quickly in sequence) will not be elaborated here.

[0062] Due to the above principle, the segment code liquid crystal display can have a further cooperative relationship with board games, maze games, and other similar types of games. Among them, "board game" can refer to a single-player or multi-player interaction system that meets the following conditions: First, there are a finite number of clearly distinguishable discrete operation objects (referred to as "pieces"), and each piece has at least one attribute (such as position, status value, belonging party, etc.) that can be recognized by the rule system; Second, the interaction behavior is achieved by changing the attributes of the pieces. In addition, "board game" usually also has the following optional features: First, there is a deterministic win-loss determination function, and the input of this function is "the set of attributes of all current pieces" (that is, the current "chess game"); Second, there is a discrete operation round division in the time dimension, and the operations allowed in each round are restricted by the current piece attribute state.

[0063] In other words, in a "board game", there is an observable state space composed of a number of independent operation objects (referred to as pieces, which can be physical entities or logical operation objects), and each entity has enumerable discrete states; each operation allowed by the rules can be expressed as a discrete change in the state of at least one entity. The compliance determination of the operation result depends on the entity state before the operation and the characteristics of the operation itself, and the end condition of the "board game" can be expressed as a logical predicate of the entity state. For example, Sudoku games and their derived single-player or multi-player Sudoku board games, or Chinese chess games, Gobang games, Go games, etc. can all be called board games. Hereinafter, the embodiments of the present disclosure will be described taking a single-player Sudoku board game as an example; in the Sudoku board game, the position of each piece on the chessboard (a certain row and a certain column), and the corresponding numerical value of the piece (usually any natural number in the closed interval [1, 9]) can constitute the attributes of the piece.

[0064] It should be understood that the "interaction" mentioned in the above interaction system may involve a computer (the computer acts as a human role), thus forming a human-computer interaction system. Alternatively, the computer may only provide the game rules or the game board, and the interaction is completed between people or by a single person alone. The present disclosure does not limit this; in the present disclosure, the two terms "game" and "interaction" may have the same meaning (a game is a system composed of various interaction rules), and the present disclosure also does not limit its entertainment and leisure attributes; later, actions such as "playing chess" and "placing a piece" may be used to refer to an interaction completed by the user.

[0065] The maze game is usually based on a "two-dimensional topological network composed of connected units and blocking units". Simply put, the puzzle of the maze game can usually be reflected by "dividing the plane space into multiple path units (i.e., a grid in the grid-like ground) and controlling the connectivity between different ground cells". That is, there are usually two types of path units in this topological network. One is the connected unit, which is a continuous area allowing free passage, and this continuous area can correspond to the dormant segments of the segment display screen. The other is the blocking unit, which is an impassable boundary (which can be called a wall), and these boundaries can correspond to the activated segments of the segment display screen. That is, different segment codes of the display unit (which can be one or more) in the segment liquid crystal display screen can correspond to different walls of the maze game, so that by controlling the activation states of different segment codes, the puzzle of the maze game is presented. In the maze game, there is also a game concept similar to that of chess pieces. The chess piece usually represents the position of the game character, and the game goal is usually to control the game character to reach a certain maze exit position.

[0066] It can be seen that both chess games and maze games can be simply implemented based on the segment liquid crystal display screen. Because both of them belong to the "discrete topology" system, and their core elements form a highly adaptable relationship with the "predefined geometric constraints" and "binary state control" characteristics of the segment liquid crystal display screen. Specifically, the entities (chess pieces / path units) of the two types of games mentioned above can be limited within a finite number of predefined space units (chessboard grids / maze channels), and the number of entity units is finite (the types of chess pieces / the presence or absence of walls): this exactly matches the geometric segment code set (i.e., the above-mentioned S) of the segment liquid crystal display screen, and the limited display ability of the segment liquid crystal display screen will not affect the display of the pictures of these games. This characteristic matching enables the logical structures of the two types of games (and other games with the above commonalities) to be directly represented by the display states of the segment codes (such as different chess pieces being mapped to different segment code combinations, and maze walls being mapped to one or more segment codes), thus achieving the optimal balance between hardware complexity and game expressiveness.

[0067] Taking the sudoku chess in the chess game as an example, please refer to Figure 1, which shows an exemplary implementation method of a segment code liquid crystal display of the present disclosure. The square grid in the figure is a chessboard, and its frame lines (i.e., the dividing lines for separating the positions for placing chess pieces) can be printed or solidified on the segment code liquid crystal display, or can be composed of activated segment codes. In the sudoku chess, each square grid can be regarded as a position for placing a chess piece, that is, the user can fill in a number at this position, and the chess game (i.e., the game screen) can be composed of the numbers (the numbers in this game are the chess pieces) at each position on the current chessboard. Further, the segment code liquid crystal display includes a plurality of display units, and each display unit is composed of a plurality of segment codes. Among them, the plurality of display units respectively correspond to a plurality of positions for placing chess pieces in the board game ( Figure 1 only two in the upper left corner are shown in the figure, and the specific quantity is not limited), and the segment code liquid crystal display is used to control the activation state of each segment code in the display unit corresponding to each position for placing a chess piece according to the above notification received (which can come from the body), so as to represent the chess piece placed at the position for placing the chess piece (for example, by controlling the display unit at a certain position for placing a chess piece to display the number "7" to indicate that a "7" chess piece is placed at this position).

[0068] In addition, the system may further include chess pieces for placing on the segment code liquid crystal display; at this time, the body can be used to determine the chess pieces placed on the segment code liquid crystal display through the sensing information collected by the sensing module, so as to obtain the user chess game formed after the user performs a physical operation on the segment code liquid crystal display (the user chess game is just a name, which can represent the situation formed by the chess pieces placed by the user on the current liquid crystal display, and the information required for the game progress can be set by itself, for example, the chess pieces currently displayed can also be included), and then according to this user chess game (that is, taking the user chess game as the input of the game algorithm), update the game screen displayed on the segment code liquid crystal display and / or determine the game result. Thus, the user can regard the segment code liquid crystal display as a real chessboard and interact with the chessboard based on real chess pieces, thereby truly simulating the game interaction process between the user and other users and improving the user's sense of interaction and early education effect. For example, Figure 1 in the figure, 3, 3, 4, and 7 are four chess pieces of the sudoku chess respectively. If the user believes that the number 3 should be filled in a certain position, the user can pick up the physical chess piece corresponding to the number 3 and place it on a position for placing a chess piece on the segment code liquid crystal display, so as to continue the game progress. In addition, when the user is playing a maze game, the chess piece can be made to act as a game character (that is, the user needs to operate the chess piece to move from a certain position to the maze exit without passing through the wall), which will not be elaborated here.

[0069] In order to reduce the cost of the sensing module and obtain higher sensing accuracy, an identification code for identifying the above-mentioned chess piece is provided on at least one surface of the above-mentioned chess piece, and the above-mentioned body is used to determine the current user chess game according to the identification code included in the image captured by the above-mentioned camera module. Among them, the identification code can be implemented based on technologies such as OID identification code, two-dimensional code, and text. Among them, the OID (Optical Identify) identification code, also known as the OID invisible code, has characteristics such as being almost invisible to the naked eye and having better adaptability to close-range scanning. In addition, the body can also be provided with a fill light for the field of view angle range of the camera module, so that the image quality collected by the camera module meets the identification standard of the identification code (that is, the body is provided with a fill light, and the irradiation range of the fill light overlaps all or part of the field of view angle range of the camera module).

[0070] It can be seen that based on the above implementation manner, the game screen is not limited to being presented in the form of printed matter, but can be presented based on a segmental LCD screen. Users can also perform physical operations on the segmental LCD screen to participate in the game process, realizing the direct combination of vision and behavior. This system constitutes a complete interactive system. Without the need to improve the hardware of the body, it can accommodate a very high degree of question richness at an extremely low cost, avoiding problems such as few questions, high cost, inconvenient use, and difficult arrangement in related technologies; at the same time, compared with directly using the LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode) screens on mobile phones and tablets, the manufacturing cost, power consumption, and required data transmission bandwidth of the segmental LCD screen are much lower, and the durability is much higher. At the same time, it can greatly alleviate users' concerns about eye protection, enabling this solution to be applied to mass consumer products.

[0071] The connection method between the body, the segmental LCD screen, and the sensing module can be either wired or wireless, either mechanically connected or of a split design. For example, Figure 2 is an exemplary optional solution. Among them, the segmental LCD screen and the body are of a split structure, and the camera module is arranged on the learning machine (that is, the body). The body and the segmental LCD screen can be provided with limiting components that cooperate with each other ( Figure 2 in which, at the joint of the segmental LCD screen and the body, a magnetic connection component or a connecting component similar to a mortise and tenon structure can be provided), and the segmental LCD screen is used to be inserted (or magnetically attracted) into the limiting component so that the segmental LCD screen is within the field of view angle range of the camera module in the above-mentioned embodiment ( Figure 2 in which, the field of view angle range is facing the desktop and is not shown in the figure).

[0072] Thus, the relationship between the body and the segment LCD screen has changed from a binding relationship to an accessory relationship. When the body needs the function of the segment LCD screen to present the game screen, the user can connect them. Otherwise, they can be separately stored or used alone. This not only gives users more freedom in choosing products (for example, users can choose to buy multiple segment LCD screens, and each segment LCD screen can be connected to the body to achieve the above functions, so as to realize multiplayer on-site or even remote battles), but also provides more freedom in storing the products after purchase. Moreover, if a certain device is damaged, the difficulty of repair and replacement is naturally lower.

[0073] It should be understood that in addition to Figure 2 the examples shown, the segment LCD screen can also be placed parallel to the body, and the present disclosure does not limit this. In addition, if the body is a learning machine (especially a learning machine other than a tablet computer), a thinking machine or other devices with preset application scenarios (enlightenment devices), then the above-mentioned sensing components can also be reused.

[0074] For example, the above-mentioned enlightenment devices usually come with matching physical books or physical cards (which can be collectively referred to as learning cards), and store the media content corresponding to the books or cards. The media transmission component assembled on the enlightenment device can use at least one media medium to present the media content corresponding to the books or cards to the user (the user usually needs to place the card in the placement area set on the learning machine). Of course, the learning card can also be printed with puzzles (such as mazes) or other questions, and the learning machine can assist the user in completing the puzzles printed on the learning card (such as judging whether the user has completed the maze through the camera module). In this example, the media for the learning machine to interact with the user is usually the camera module (whose shooting range is usually the placement area or the user's face area, used to collect the content information of the learning card or the behavior information of the user) and the speaker. Therefore, the limiting component can be used to limit the learning card and the segment LCD screen, so that when the user needs the learning card, they can directly place the learning card in the placement area; and when they need the segment LCD screen, they can also directly place the segment LCD screen in the placement area, so as to directly reuse the above-mentioned limiting component and camera module (of course, the speaker can also be used as a way to present game content) to realize the functions or methods described in the embodiments of the present disclosure. The user does not need to perform a special alignment operation, and the screen can also be within the acquisition range of the camera module. Thus, in the eyes of the user, the presence of the learning card and the segment LCD screen is the same (that is, the segment LCD screen can be regarded as a special learning card), and it is not easy to have a sense of fragmentation when using various functions, so that the segment LCD screen truly replaces the printed problem cards (learning cards) at extremely low cost, and the user may not need to purchase a new learning machine body for this.

[0075] To further enhance the user experience, the above-mentioned segment LCD screen may further include a battery (the segment LCD screen generally has extremely low power consumption, so it can still be extremely thin and light after including the battery); in addition, the above-mentioned body is used to control the display of the game screen of the target game based on a wireless connection communication method (such as local area network connection or Bluetooth connection). By deploying the battery and the wireless communication module, the segment LCD screen can become a completely independent and assemblable component. Thus, the beneficial effects brought by the above-mentioned scenario are further strengthened, and users can more freely select various accessories of the body at any time without having to sort out various cables; combined with the above content of "regarding the segment LCD screen as a special learning card", the sense of technology felt by users will be greatly improved. For the early education field, it can further arouse children's interest in technology and their hands-on ability related to electronic products.

[0076] The second aspect of the present disclosure provides an interaction method, which can be applied to the body in the interaction system described in at least one embodiment of the first aspect. The interaction system further includes a segment LCD screen and a sensing module, and both the above-mentioned segment LCD screen and the above-mentioned sensing module are connected to the above-mentioned body; please refer to Figure 3 , the above method includes:

[0077] Step S301, in response to the selection of the target game, notify the segment LCD screen to display the game screen corresponding to the target game.

[0078] The structural details, functional details, and beneficial effects of the embodiments of the first aspect can be mutually referred to and supplemented with the embodiments of the second aspect. For example, the above-mentioned target game may include board games (the maze game will not be elaborated), and the above-mentioned game screen includes the chessboard of the above-mentioned board game; the above-mentioned segment LCD screen includes a plurality of display units, and each display unit is composed of a plurality of segments. Among them, the above-mentioned plurality of display units respectively correspond to the plurality of chess piece placement positions of the above-mentioned board game, and the above-mentioned segment LCD screen is used to characterize different chess pieces placed on the above-mentioned chess piece placement positions by controlling the activation state of each segment in the display unit corresponding to each chess piece placement position.

[0079] The above method may further include: receiving a user instruction indicating game difficulty information, and determining the chessboard of the above-mentioned board game according to the above-mentioned game difficulty information; sending a control instruction to the above-mentioned segment LCD screen to make the above-mentioned segment LCD screen present the chessboard of the above-mentioned board game.

[0080] The ways to receive instructions can include voice recognition, obtaining from other devices (such as smart speakers, mobile clients), button input, touch input, etc. If the device supports multiple games, segment LCD screens corresponding to each game can be designed, or one segment LCD screen can be made to display multiple games (for example, the game boards of board games such as Go and Gomoku are very similar; alternatively, designing multiple groups of display units corresponding to different games is also feasible). The device can preset game algorithms or game rules corresponding to multiple game difficulty levels. Among them, the game algorithms can be used to determine the initial game screen (chessboard) or the intellectual performance of the device during the interaction with the user, and the game rules can be used to determine game goals, feasible physical operations, etc.

[0081] Step S302: Obtain the image collected by the camera module, and determine the operation result obtained after the user performs an operation on the game screen displayed on the segment LCD screen based on the obtained image.

[0082] This "operation result" can either refer to "a certain physical operation is completed" in the action dimension (for example, the user points to a certain position with a fingertip and stays for a preset duration, or the user makes a move in a game), or refer to the entity result formed by the physical operation in the entity dimension (for example, the new chessboard obtained after the user places a certain chess piece on the segment LCD screen). After these operations are recognized, they can be converted into information in a preset format (this information can represent the global information of the chessboard or the operations performed by the user) as the input of the target game and input into the algorithm of the target game, so as to achieve compatibility with the original algorithm logic (only the input and output media have changed).

[0083] Step S303: Control the scheduling of the target game according to the operation result, so that the segment LCD screen displays the corresponding game screen according to the scheduling of the target game by the device.

[0084] In addition, the method can further include: determining whether the game process of the user needs to be intervened according to the physical operation performed by the user on the above game screen; if the game process of the user needs to be intervened, controlling the above segment LCD screen to display intervention information at each target intervention position, where the above target intervention positions include at least one chess piece placement position of the above preset board game.

[0085] "Scheduling" here can refer to "the result of the game", namely "no change", "game success", "game failure", "need to update the screen (for example, in a gobang game, after one side completes the action of placing a piece, the other side played by the machine can place a piece, then the game screen needs to be updated)", etc. In addition, the above-mentioned machine can also be used to control the segment LCD screen to update the chess game board according to the operation result. For example, the control of the scheduling of the target game according to the operation result includes: determining the game progress of the target game according to the operation result; and notifying the segment LCD screen to update the game screen corresponding to the target game according to the game progress. The "game progress" here can also refer to game reference information in any dimension, such as the attributes of the pieces that the current user has placed, the attributes of all the pieces in the whole game, the number of game rounds that have been executed, the time that has been consumed so far, etc.; it can be understood as the meaning of "game state" or "game process". For example, in the above content about gobang, when the current game progress reaches the round when the machine places a piece (that is, the user has completed placing a piece), the machine can determine where to place the next piece and control the display screen to show the new game board content (such as adding a new piece to represent the piece that the machine has just placed).

[0086] Continuing with Sudoku as an example. The physical operations that need to be intervened can include "no operation for a long time", "placing the piece in the wrong position", "placing the wrong piece in the correct position", etc., which can be determined based on the factory settings and user settings; at the same time, the concept of this "operation" may not be limited to the operations performed on the game screen, but other sensor data can also be added (extending it to the behaviors of the user during the game), such as "the current user's expression", "whether the current user utters a query statement", etc. judged by the camera module, visual focus sensor, microphone or other sensors.

[0087] When the operations performed by the user on the Sudoku include the above-mentioned "physical operations that need to be intervened", it can be considered that the current game process of the user needs to be intervened. The intervention methods can be to prompt the correct position to the user, prompt both the correct position and the correct piece to the user, prompt the wrong position or the wrong piece to the user, etc. Therefore, after determining that intervention is needed, the machine can first determine the target intervention position and the information to be displayed at the target intervention position (such as correct or wrong, which correct or recommended piece should be), and then display this information on the segment LCD screen, so as to continue to utilize the advantages of the segment LCD screen, enable it to present more rich content, and thus improve the user experience and educational quality. This intervention behavior is directly presented on the chessboard, and its intuitiveness is far beyond that of traditional voice intervention and mobile phone display.

[0088] In summary, based on the above embodiments, the game screen is not limited to being presented in the form of printed matter, but can be presented based on a segmental LCD screen. Users can also perform physical operations on the segmental LCD screen to participate in the game process, achieving a direct combination of vision and behavior. This method, combined with the system, constitutes a complete user interaction system. Without the need to improve the hardware of the machine body, it can accommodate a very high degree of question richness at extremely low cost, avoiding problems such as few questions, high cost, inconvenient use, and difficult sorting in related technologies, and providing better user experience and educational quality. At the same time, compared with directly using LCD and OLED screens on mobile phones and tablets, the manufacturing cost, power consumption, and required data transmission bandwidth of the segmental LCD screen are much lower, and its durability is much higher. At the same time, it can greatly alleviate users' concerns about eye protection, enabling this solution to be applied to mass consumer products.

[0089] The present disclosure also provides an interaction device that can be applied to the machine body in the interaction system (or other similar systems) as described in the first aspect. The interaction system further includes a segmental LCD screen and a sensing module. The sensing module and the segmental LCD screen can be separately provided from the machine body or integrated with the machine body; please refer to Figure 4 , the device includes:

[0090] A display control module 401, configured to respond to the selection of a target game and notify the segmental LCD screen to display the game screen corresponding to the target game;

[0091] An information acquisition module 402, configured to obtain the image collected by the camera module and determine the operation result obtained after the user performs an operation on the game screen displayed on the segmental LCD screen according to the obtained image;

[0092] A game control module 403, configured to control the scheduling of the target game according to the operation result, so that the segmental LCD screen displays the corresponding game screen according to the scheduling of the target game by the machine body.

[0093] Optionally, the target game includes a board game, and the game screen includes the chessboard of the board game; the segmental LCD screen includes a plurality of display units, and each display unit is composed of a plurality of segment codes. Among them, the plurality of display units respectively correspond to the placement positions of the plurality of chess pieces in the board game, and the segmental LCD screen is used to represent different chess pieces placed at the chess piece placement positions by controlling the activation state of each segment code in the display unit corresponding to each chess piece placement position;

[0094] When the above game control module is used to control the scheduling of the target game according to the operation result, it is specifically used for:

[0095] Determine the game progress of the target game according to the operation result;

[0096] According to the game progress, notify the segment LCD to update the game screen corresponding to the target game.

[0097] The device further includes a chess game determination module for performing the following steps:

[0098] Receive a user instruction indicating game difficulty information, and determine the chess game board according to the game difficulty information;

[0099] Send a control instruction to the segment LCD to cause the segment LCD to display the chess game board.

[0100] Optionally, the device further includes an intervention module for performing the following steps:

[0101] Determine whether the user's game process needs to be intervened according to the physical operations performed by the user on the game screen;

[0102] If the user's game process needs to be intervened, control the segment LCD to display intervention information at each target intervention position, where the target intervention position includes at least one piece placement position of the preset chess game.

[0103] For the implementation processes of the functions and roles of each module in the above device, please refer to the implementation processes of the corresponding steps in the above method for details, which will not be elaborated here.

[0104] In addition, the present disclosure also provides a computer program product, including a computer program / instructions, which implement the above method when executed by a processor.

[0105] For the device embodiment and the computer program product embodiment, since they basically correspond to the method embodiment, the relevant parts can refer to the partial description of the method embodiment. In addition, the device embodiments described above are only illustrative. The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed to multiple network modules. Some or all of the modules can be selected according to actual needs to achieve the purpose of the present disclosure solution. Those of ordinary skill in the art can understand and implement it without creative efforts.

[0106] Adaptively, the present disclosure also provides a learning machine, which can be the learning machine in the above interactive system or other similar systems. Please refer to Figure 5, which shows the structure of the learning machine. The learning machine includes a memory and a processor. The memory is used to store computer instructions that can run on the processor, and the processor is used to implement the methods shown in any of the foregoing embodiments when executing the computer instructions. Additionally, optionally, the learning machine may further include a camera module, which can serve as the camera module mentioned in the embodiments of the first aspect or the second aspect. Moreover, the camera module can also be used to collect the content on items such as learning cards and question cards paired with the learning machine and reused in the embodiments provided in the present disclosure.

[0107] Adaptively, the present disclosure also provides a non-transitory computer-readable storage medium including instructions, such as a memory including instructions. The above instructions can be executed by the learning machine or the processor of the learning machine to complete the methods shown in any of the foregoing embodiments. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device, etc.

[0108] It should be understood that in some cases, the actions or steps recited in the claims can be executed in a different order from those in the embodiments and still achieve the desired results. Also, the embodiments provided in the present disclosure can be applied independently, or combined and comprehensively applied with each other. The present disclosure aims to cover any variations, uses, or adaptive changes of the present disclosure, which follow the general principles of the present disclosure and include the common general knowledge or conventional technical means in the technical field not claimed in the present disclosure. In addition, the content provided above is only the preferred embodiments of the present disclosure and is not used to limit the present disclosure. Any modifications, equivalent replacements, improvements, etc., made within the spirit and principles of the present disclosure shall be included within the scope of protection of the present disclosure.

Claims

1. An interactive system, characterized in that: Including body, segment code LCD screen and camera module; Wherein, the body is used for: In response to the selection of the target game, the segment code LCD screen is notified to display the game screen corresponding to the target game; and Obtaining images captured by the camera module; and, Determine, based on the acquired image, an operation result obtained after the user performs an operation on the game screen displayed on the segment code LCD screen; and Controlling the scheduling of the target game according to the operation result; The segment code LCD screen is used to: after receiving a notification sent by the machine, display the game screen corresponding to the target game according to the notification; and display the corresponding game screen according to the scheduling of the target game by the machine; The camera module is deployed on the machine body, or is independent of the machine body; The camera module is used to capture the content of the display area of ​​the segment code LCD screen.

2. The interactive system according to claim 1, characterized in that: The target game includes a chess game, and the game screen includes a chess game of the chess game; The segment code LCD screen includes a plurality of display units, each display unit is composed of a plurality of segment codes, wherein the plurality of display units respectively correspond to a plurality of chess piece placement positions of the chess game; The segment code LCD screen is used for: The chess piece placed at each chess piece placement position is represented by controlling the activation state of each segment code in the display unit corresponding to each chess piece placement position.

3. The interactive system according to claim 2, characterized in that: The system also includes chess pieces, which are used to be placed on the segment code LCD screen; the operation result includes a user chess game formed by the chess pieces placed on the segment code LCD screen.

4. The interactive system according to claim 3, characterized in that: An identification code for identifying the chess piece is provided on at least one surface of the chess piece, and the body is used to determine the operation result according to the identification code contained in the image taken by the camera module, wherein the identification code includes at least one of the following: OID identification code, QR code, text.

5. The interactive system according to claim 2, characterized in that: The segment code LCD screen and the body are separate structures, the camera module is deployed on the body, the body is provided with a limit assembly, and the segment code LCD screen is used to be inserted into the limit assembly so that the segment code LCD screen is located within the field of view angle range of the camera module.

6. The interactive system according to claim 1, characterized in that: The segment code LCD screen and the body are separate structures, the segment code LCD screen includes a battery, and the body is used to control the segment code LCD screen to display the game screen of the target game based on a wireless connection communication method; And / or, the target game includes at least one of a Sudoku game, a Gobang game, and a Go game.

7. An interactive method, characterized in that: A machine body used in an interactive system, wherein the interactive system further comprises a segmented LCD screen and a camera module, wherein the camera module is deployed in the machine body or is independent of the machine body; the method comprises: In response to the selection of the target game, the segment code LCD screen is notified to display the game screen corresponding to the target game; Obtaining an image captured by the camera module, and determining, based on the obtained image, an operation result obtained after the user performs an operation on the game screen displayed on the segment code LCD screen; The scheduling of the target game is controlled according to the operation result, so that the segment code LCD screen displays the corresponding game screen according to the scheduling of the target game by the machine body.

8. The interactive method according to claim 7, characterized in that: The controlling the scheduling of the target game according to the operation result includes: Determining the game progress of the target game according to the operation result; According to the game progress, the segment code LCD screen is notified to update the game screen corresponding to the target game.

9. The interactive method according to claim 8, characterized in that: The method further comprises: Determining whether the user's gaming process requires intervention based on a physical operation performed by the user on the segmented LCD screen; If the user's gaming process requires intervention, the segment code LCD screen is controlled to display intervention information at a target intervention position, wherein the target game includes a chess game, and the target intervention position includes at least one chess piece placement position of the target game.

10. A learning machine, characterized in that: It comprises a camera module, a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the method as claimed in any one of claims 7 to 9 when executing the computer program.

Images