User operation guidance method, device and equipment based on user operation behavior

Abstract

The present application relates to the field of entity interaction technology, and in particular to a user operation guidance method, device and equipment based on user operation behavior, wherein the method includes: collecting the interaction action data of the current user on the entity interface; extracting features of the interaction action data to obtain the current action features, and determining the target action features of the current user at the next moment based on the current action features, and obtaining the sound feedback signal corresponding to the target action features from the preset action feature-sound signal table; playing the real-time sound feedback signal to guide the current user to perform the next action on the entity interface through the played sound feedback signal. In this way, the potential problems of entity interaction are improved from the auditory dimension, and sound feedback in entity interaction activities is realized, thereby prompting users to adopt different interaction strategies for the entity interface.

Description

Technical Field

[0001] The present application relates to the field of entity interaction technology, and in particular to a user operation guidance method, device and equipment based on user operation behavior. Background Art

[0002] Physical interaction has the advantages of using intuitive body movements to interact, extending the interaction process into the real environment, and using embodied experience to create interactive meaning. However, it also has the limitations of limited accuracy and reusability of physical interaction and limited affordances of physical interfaces.

[0003] In related technologies, in order to address the design challenges brought about by the above-mentioned limitations of physical interaction, augmented reality (Augmented Reality) technology is usually integrated from the visual dimension to give the physical interface stronger visual expressiveness.

[0004] However, how to use sound in physical interaction design and the corresponding design principles are still not comprehensive and need to be improved urgently. Summary of the invention

[0005] The present application provides a user operation guidance method, device and equipment based on user operation behavior, which improves potential problems of entity interaction from the auditory dimension, realizes sound feedback in entity interaction activities, and then prompts users to adopt different interaction strategies for the entity interface.

[0006] The first aspect of the present application provides a method for guiding user operation based on user operation behavior, comprising the following steps:

[0007] Collect the current user's interactive action data on the physical interface;

[0008] Extracting features from the interactive action data to obtain current action features, determining target action features of the current user at the next moment based on the current action features, and obtaining a sound feedback signal corresponding to the target action features from a preset action feature-sound signal table; and

[0009] The sound feedback signal is played to guide the current user to perform a next action on the physical interface through the played sound feedback signal.

[0010] According to an embodiment of the present application, the motion feature includes at least one of a motion trajectory, a touch position, a touch force, and a touch duration.

[0011] According to an embodiment of the present application, before obtaining the sound feedback signal corresponding to the target action feature from the preset action feature-sound signal table, the method further includes:

[0012] Determine a plurality of sound signals to be tested, wherein each sound signal to be tested includes tone, sound intensity and pitch;

[0013] Based on the tone, intensity and pitch of each sound signal to be tested, obtaining action feature sets of multiple target users under each sound signal to be tested;

[0014] The action features satisfying the preset screening conditions are eliminated from the action feature set to obtain the action features corresponding to each sound signal to be tested, and the preset action feature-sound signal table is generated according to the action features corresponding to each sound signal to be tested.

[0015] According to an embodiment of the present application, the interactive action data includes at least one of a deformation action, a displacement action and an instantaneous action.

[0016] According to an embodiment of the present application, determining the target action feature of the current user at the next moment according to the current action feature includes:

[0017] Based on the corresponding relationship between the shape and the spatial position of the physical interface, the target action feature of the current user at the next moment is determined according to the current action feature.

[0018] According to the user operation guidance method based on user operation behavior provided by the embodiment of the present application, by collecting the user's interactive action data and extracting features, the user's target action features at the next moment are determined, and the corresponding sound feedback signal is obtained according to the preset action feature-sound signal table, and played in real time to guide the user to perform the next action. Thus, the potential problems of entity interaction are improved from the auditory dimension, and sound feedback in entity interaction activities is realized, thereby prompting users to adopt different interaction strategies for the entity interface.

[0019] A second aspect of the present application provides a user operation guidance device based on user operation behavior, including:

[0020] The collection module is used to collect the interactive action data of the current user on the physical interface;

[0021] a feature extraction module, configured to extract features from the interactive action data to obtain current action features, determine target action features of the current user at the next moment based on the current action features, and obtain a sound feedback signal corresponding to the target action features from a preset action feature-sound signal table; and

[0022] The guiding module is used to play the sound feedback signal to guide the current user to perform the next action on the physical interface through the played sound feedback signal.

[0023] According to an embodiment of the present application, the motion feature includes at least one of a motion trajectory, a touch position, a touch force, and a touch duration.

[0024] According to an embodiment of the present application, before obtaining the sound feedback signal corresponding to the target action feature from the preset action feature-sound signal table, the feature extraction module is further used to:

[0025] Determine a plurality of sound signals to be tested, wherein each sound signal to be tested includes tone, sound intensity and pitch;

[0026] Based on the tone, intensity and pitch of each sound signal to be tested, obtaining action feature sets of multiple target users under each sound signal to be tested;

[0027] The action features satisfying the preset screening conditions are eliminated from the action feature set to obtain the action features corresponding to each sound signal to be tested, and the preset action feature-sound signal table is generated according to the action features corresponding to each sound signal to be tested.

[0028] According to an embodiment of the present application, the interactive action data includes at least one of a deformation action, a displacement action and an instantaneous action.

[0029] According to one embodiment of the present application, the feature extraction module is used to:

[0030] Based on the corresponding relationship between the shape and the spatial position of the physical interface, the target action feature of the current user at the next moment is determined according to the current action feature.

[0031] According to the user operation guidance device based on user operation behavior provided by the embodiment of the present application, by collecting the user's interactive action data and extracting features, the user's target action features at the next moment are determined, and the corresponding sound feedback signal is obtained according to the preset action feature-sound signal table, and played in real time to guide the user to perform the next action. Thus, the potential problems of entity interaction are improved from the auditory dimension, and sound feedback in entity interaction activities is realized, thereby prompting users to adopt different interaction strategies for the entity interface.

[0032] The third aspect of the present application provides an electronic device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the user operation guidance method based on user operation behavior as described in the above embodiment.

[0033] The fourth aspect of the present application provides a computer-readable storage medium, which stores computer instructions, and the computer instructions are used to enable the computer to execute the user operation guidance method based on user operation behavior as described in the above embodiment.

[0034] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0036] Figure 1 A flowchart of a user operation guidance method based on user operation behavior provided according to an embodiment of the present application;

[0037] Figure 2 is a schematic diagram of the shape of a physical interface according to an embodiment of the present application;

[0038] Figure 3 A schematic diagram of basic settings for a puzzle game according to an embodiment of the present application;

[0039] Figure 4 A basic flow chart of the interaction of a puzzle game according to an embodiment of the present application;

[0040] Figure 5 is a schematic diagram of an interaction mechanism according to an embodiment of the present application;

[0041] Figure 6 A schematic diagram of an interactive cycle process according to an embodiment of the present application;

[0042] Figure 7 is an interactive flow chart according to an embodiment of the present application;

[0043] Figure 8 Schematic diagram of a block diagram of a user operation guiding device based on user operation behavior according to an embodiment of the present application;

[0044] Fig. 9 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0045] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.

[0046] The following describes the user operation guidance method, device and equipment based on user operation behavior of the embodiment of the present application with reference to the accompanying drawings. In view of the problem of how to use sound in entity interaction design mentioned in the above background technology and the problem that the corresponding design principles are not comprehensive, the present application provides a user operation guidance method based on user operation behavior, which improves the potential problems of entity interaction from the auditory dimension, realizes sound feedback in entity interaction activities, and then prompts users to adopt different interaction strategies for the entity interface.

[0047] Specifically, Figure 1 A flowchart of a user operation guidance method based on user operation behavior provided in an embodiment of the present application.

[0048] like Figure 1 As shown, the user operation guidance method based on user operation behavior includes the following steps:

[0049] In step S101, the interaction action data of the current user on the physical interface is collected.

[0050] In some embodiments, the interactive action data includes at least one of a deformation action, a displacement action, and a transient action. A deformation action refers to a continuous action applied on a physical interface to deform the interface, such as "pinching" or "pressing". A displacement action refers to a continuous change in the spatial position of an operation gesture on a physical interface, such as a "slide". A transient action refers to a transient contact action applied to a physical interface, such as "patting", "touching", "knocking", and other actions.

[0051] Preferably, the physical interface of the embodiment of the present application can adopt a touch capacitive sensing method. The embodiment of the present application can also collect the interactive action data of the current user on the physical interface through a microcontroller Arduino Nano in conjunction with a CD74HC4067 multi-bit multiplexer.

[0052] It should be noted that the above-mentioned collection of the current user's interactive action data on the physical interface by means of the microcontroller Arduino Nano in conjunction with the CD74HC4067 multi-bit multiplexer is only exemplary and not intended to be a limitation of the present application. Those skilled in the art may adopt other methods to collect the current user's interactive action data on the physical interface according to actual conditions. To avoid redundancy, it will not be described in detail here.

[0053] In step S102, feature extraction is performed on the interactive action data to obtain the current action feature, and the target action feature of the current user at the next moment is determined based on the current action feature, and the sound feedback signal corresponding to the target action feature is obtained from a preset action feature-sound signal table.

[0054] In some embodiments, the motion feature includes at least one of a motion trajectory, a touch position, a touch force, and a touch duration.

[0055] Specifically, by extracting the features of action data, a large amount of irrelevant information can be filtered and reduced in dimension, making the data more streamlined and easier to process. By analyzing the action features of the current user, the target action features of the user at the next moment can be inferred, providing timely feedback and predictions to help users make timely adjustments and guidance. By obtaining the sound feedback signal corresponding to the target action feature from the preset action feature-sound signal table, direct sound stimulation can be generated within the user's perception range, attracting the user's attention and increasing self-perception and attention to the execution of the action.

[0056] Further, in some embodiments, determining the target action feature of the current user at the next moment according to the current action feature includes: determining the target action feature of the current user at the next moment according to the current action feature based on the correspondence between the shape and spatial position of the physical interface.

[0057] The shape of the physical interface can be of many kinds, such as square, circle, etc., which are not specifically limited here. Figure 2 As shown, the shape of the physical interface of the embodiment of the present application can be a circular ring shape. The target action feature is an action feature preset based on the current action feature of the user.

[0058] Specifically, the shape of the physical interface can correspond to the spatial position relationship, and the user can perform interactive actions related to spatial movement through the physical interface. The action should be a continuous action, and at each time node, the position of the action subject is different. Since the shape of the physical interface can provide guidance for the motion trajectory, the target action features of the current user at the next moment can be determined based on the current action features.

[0059] For example, for a physical interface in the shape of a ring, its geometric shape can provide guidance for the motion trajectory, that is, movement along the circumference. Therefore, when the user's current action feature is touching the ring with a finger, it is determined that the user's target action feature at the next moment is sliding around the circumference of the ring.

[0060] Furthermore, in some embodiments, before obtaining the sound feedback signal corresponding to the target action feature from the preset action feature-sound signal table, it also includes: determining multiple sound signals to be tested, wherein each sound signal to be tested includes tone, intensity and pitch; based on the tone, intensity and pitch of each sound signal to be tested, obtaining action feature sets of multiple target users under each sound signal to be tested; eliminating action features in the action feature set that meet preset screening conditions to obtain action features corresponding to each sound signal to be tested, and generating a preset action feature-sound signal table based on the action features corresponding to each sound signal to be tested.

[0061] For example, the sound signal to be tested is coherent and continuous, and the action feature set obtained is "sliding", "continuous squeezing", "displacement", "knocking", "fear of hitting", and "instantaneous pressing", then the intermittent and instantaneous action features of "knocking", "fear of hitting", and "instantaneous pressing" are eliminated, and the action features corresponding to the coherent and continuous sound signal to be tested are "sliding", "continuous squeezing", and "displacement".

[0062] Specifically, as shown in Table 1, Table 1 shows the proportion of different subject actions taken by the 12 subjects in response to different sound feedbacks in groups A and B.

[0063] Table 1

[0064]

[0065] In the case of sound feedback in Group A (energy metaphor), the action feature sets of 12 subjects were obtained as "deformation action", "displacement action", "instantaneous action" and "other actions". Among them, 8 subjects used interactive actions mainly based on "pinching" and "pressing". These actions can be set as the theme of "deformation action". "Deformation action" accounts for the largest proportion in the action feature set. Therefore, "displacement action", "instantaneous action" and "other actions" in the action feature set are eliminated, and the preset action feature corresponding to the sound feedback in Group A is "deformation action".

[0066] In the case of sound feedback in Group B (energy metaphor), the action feature sets of 12 subjects were obtained as "deformation action", "displacement action" and "other actions". Among them, 9 subjects used continuous interactive actions similar to "sliding". These actions were set as the theme of "displacement action", that is, the tendency of the action was to try to make continuous displacement of gestures on the physical interface. "Displacement action" accounted for the largest proportion in the action feature set. Therefore, "deformation action" and "other actions" in the action feature set were eliminated, and the preset action feature corresponding to the sound feedback in Group B was obtained as "displacement action".

[0067] In step S103, a real-time sound feedback signal is played to guide the current user to perform the next action on the physical interface through the played sound feedback signal.

[0068] Among them, sound feedback is based on the spatial metaphor of sound, and its content is continuous music with continuously changing pitch, providing a continuous sliding affordance. Considering the dependence of sound performance on time (any sound has its duration), the affordance of sound needs to be effective within a certain period of time. Therefore, sound feedback needs to be based on interactive activities per unit time, and the effect of sound feedback cannot be achieved through a single interactive cycle.

[0069] Specifically, the physical interaction activities involving sound feedback are a continuous cycle. There is a mapping relationship between sound feedback and user interaction actions, and users can form a comprehensive judgment on the interaction mode of the entire interactive system based on the affordances brought by sound feedback and the affordances of the physical interface itself. On the premise that the user has identified all affordances of the physical interface, the user often adopts the strategy of matching the affordances of the physical interface with the affordances of sound feedback to perform the next action. When there are unnoticed affordances in the physical interface, sound feedback can also play a role in guiding users to identify the corresponding affordances.

[0070] As a result, real-time sound feedback signals can immediately convey information to users, who can directly hear the guidance of the action and quickly respond and perform the next action, which helps users better understand and master the operation of the physical interface.

[0071] In order to help those skilled in the art to more clearly and intuitively understand the user operation guidance method based on user operation behavior in the embodiment of the present application, a detailed description is given below in conjunction with specific embodiments.

[0072] The embodiment of the present application starts from the game scene of entity interaction and applies the sound feedback design principle of entity interaction, such as Figure 3 As shown, Figure 3 This is a basic setting diagram for a puzzle game, where: Figure 3 (a) to Figure 3 (c) are schematic diagrams of the puzzle game in different scenarios. Since the game is set to "explore in the dark", the game will not use visual elements as the main clues to solve the puzzle. The main obstacle that players will face is how to locate and find the way in a dark environment, and then find the props needed to solve the puzzle and the exit of the maze. To solve this problem, the game introduces real-time sound feedback.

[0073] Since the game uses a physical interaction solution, the game's interactive interface should have an intuitive and concrete physical form, and be able to provide richer perceptual information than a mouse and keyboard. During the game, the player's goal is to interact with the physical interface in an appropriate way and ultimately determine the correct direction of the puzzle props or maze exit.

[0074] Specifically, the basic process of game interaction is as follows: Figure 4 As shown, the "detection panel" part of the game's physical interaction interface is the core of the embodiment of the present application. The "detection panel" is designed to help users find the direction of puzzle props and maze exits in a dark maze; at the same time, as a physical interface, the "detection panel" also needs to form a mutual mapping relationship with the virtual world of the game. Users can make actions related to orientation on the "detection panel", and the system provides real-time sound feedback, so that users can determine the correct direction of movement of the "Photon" in the interactive cycle.

[0075] Furthermore, in the design of this game, the purpose of the user's interaction with the system is to find the correct direction to move forward. From this point of view, the common embodied metaphor basis of the physical interface and the corresponding sound feedback is determined to be "spatial metaphor". First, the shape of the physical interface can correspond to the spatial position relationship, and the user can perform interactive actions related to spatial movement through the physical interface; secondly, the sound feedback corresponding to the operation of the physical interface can evoke associations with spatial relationships. The physical interface is designed as a ring with a certain width, because there are many circular objects in daily life that are used to indicate directions, such as circular dashboards, circular compasses, etc.; the sound feedback of the operation action is a synthetic sound with pitch as the main variable parameter.

[0076] Although the sound of pitch change is selected as the real-time sound feedback, the logic of the sound pitch change needs to be determined by the characteristics of the specific interactive action. For the physical interface in the shape of a ring, its geometric shape can provide guidance for the motion trajectory, that is, movement along the circumference. Therefore, the preset interactive action is: the user touches the ring with his finger and slides around the circumference of the ring. The core features of this action include two points: first, it is a continuous action; second, at each time node, the position of the subject of the action is different. The sound feedback should be able to match the "continuous" feature, and when the subject of the action is in different positions, there will be certain differences in the sound feedback. Therefore, if Figure 5 As shown, the matching relationship between the pitch change of the sound feedback and the interactive action is: the tone matches the sliding position. When the sliding position points to the target prop of the game, the corresponding tone is the highest, and as the sliding position moves away from this position, the tone gradually drops to the lowest.

[0077] Furthermore, the core gameplay of the game is "exploration", and the direction of exploration is determined by the user's interactive actions. Exploration is a continuous process and cannot be completed overnight. The sliding action of the ring can trigger sound, and the sliding action itself is also guided by sound feedback. Game design needs to utilize such a cyclic process to play the role of real-time sound feedback. Figure 6 As shown, in the interactive loop of the game, the user slides the ring, finds the direction to go, moves forward, the user slides the ring again, finds the direction to go... At different time points, the user's actions will produce sound feedback of different pitches. In turn, the sound feedback allows the user to further determine whether the current action points to the correct detection direction (the direction with the highest pitch).

[0078] It should be noted that in actual games, in addition to the sound feedback from using the "detection panel", there will be other sound elements such as background music and game sound effects. Although they are not necessarily triggered continuously, it is still necessary to pay attention to the interference of these sound elements with the core sound feedback. The mixture of multiple sounds or the change of multiple parameters of the same sound will interfere with the user's judgment. Therefore, the equalization (EQ) adjustment of all sounds in the game will timely block other irrelevant sound bands when operating the "detection panel". And the sound timbre of this link will be designed as a highly recognizable, clear and clean synthetic sound.

[0079] Furthermore, the embodiment of the present application adopts a protruding "ring" shape design for the physical interface to provide potential indicators of interaction. The user can slide his finger along the circumference to traverse all directions of the "Photon". When the user touches the physical interface and slides, there will be real-time sound feedback, and the sound feedback stops when the user no longer touches the interface. The sound feedback is based on the spatial metaphor of sound. The content is continuous music with continuously changing pitch, providing an indicator of continuous sliding. The logic of pitch change is: the pitch is the highest in the direction pointing to the target prop or maze exit, and the pitch on both sides decays to the lowest in turn. The entire interactive cycle is like this. Figure 7 shown.

[0080] S701, enter "detection mode".

[0081] S702, slide the "detection panel".

[0082] S703, determine whether the "pitch is the highest", if yes, execute S704, otherwise, execute S702.

[0083] S704, control the spacecraft forward.

[0084] According to the user operation guidance method based on user operation behavior proposed in the embodiment of the present application, by collecting the user's interactive action data and extracting features, the user's target action features at the next moment are determined, and the corresponding sound feedback signal is obtained according to the preset action feature-sound signal table, and played in real time to guide the user to perform the next action. In this way, the potential problems of entity interaction are improved from the auditory dimension, and sound feedback in entity interaction activities is realized, thereby prompting users to adopt different interaction strategies for the entity interface.

[0085] Next, a user operation guiding device based on user operation behavior proposed in an embodiment of the present application is described with reference to the accompanying drawings.

[0086] Figure 8 4 is a block diagram of a user operation guiding device 10 based on user operation behavior according to an embodiment of the present application.

[0087] like Figure 8 As shown, the user operation guiding device 10 based on user operation behavior includes: a collection module 100, a feature extraction module 200 and a guiding module 300.

[0088] Among them, the acquisition module 100 is used to collect the interactive action data of the current user on the physical interface; the feature extraction module 200 is used to extract features from the interactive action data to obtain the current action features, and determine the target action features of the current user at the next moment based on the current action features, and obtain the sound feedback signal corresponding to the target action features from the preset action feature-sound signal table; the guidance module 300 is used to play the real-time sound feedback signal to guide the current user to perform the next action on the physical interface through the played sound feedback signal.

[0089] Furthermore, in some embodiments, the motion feature includes at least one of a motion trajectory, a touch position, a touch force, and a touch duration.

[0090] Furthermore, in some embodiments, before obtaining the sound feedback signal corresponding to the target action feature from the preset action feature-sound signal table, the feature extraction module 200 is also used to: determine multiple sound signals to be tested, wherein each sound signal to be tested includes tone, intensity and pitch; based on the tone, intensity and pitch of each sound signal to be tested, obtain action feature sets of multiple target users under each sound signal to be tested; eliminate action features in the action feature set that meet preset screening conditions to obtain action features corresponding to each sound signal to be tested, and generate a preset action feature-sound signal table based on the action features corresponding to each sound signal to be tested.

[0091] Furthermore, in some embodiments, the interactive action data includes at least one of a deformation action, a displacement action, and a transient action.

[0092] Furthermore, in some embodiments, the feature extraction module 200 is used to determine the target action feature of the current user at the next moment according to the current action feature based on the correspondence between the shape and the spatial position of the physical interface.

[0093] It should be noted that the aforementioned explanation of the embodiment of the user operation guidance method based on user operation behavior is also applicable to the user operation guidance device based on user operation behavior of this embodiment, and will not be repeated here.

[0094] According to the user operation guidance device based on user operation behavior proposed in the embodiment of the present application, by collecting the user's interactive action data and extracting features, the user's target action features at the next moment are determined, and the corresponding sound feedback signal is obtained according to the preset action feature-sound signal table, and played in real time to guide the user to perform the next action. In this way, the potential problems of entity interaction are improved from the auditory dimension, and sound feedback in entity interaction activities is realized, thereby prompting users to adopt different interaction strategies for the entity interface.

[0095] Fig. 9 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. The electronic device may include:

[0096] A memory 901 , a processor 902 , and a computer program stored in the memory 901 and executable on the processor 902 .

[0097] When the processor 902 executes the program, the user operation guiding method based on the user operation behavior provided in the above embodiment is implemented.

[0098] Furthermore, the electronic device further comprises:

[0099] The communication interface 903 is used for communication between the memory 901 and the processor 902 .

[0100] The memory 901 is used to store computer programs that can be executed on the processor 902 .

[0101] The memory 901 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0102] If the memory 901, the processor 902 and the communication interface 903 are implemented independently, the communication interface 903, the memory 901 and the processor 902 can be connected to each other through a bus and communicate with each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig. 9 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0103] Optionally, in a specific implementation, if the memory 901, the processor 902 and the communication interface 903 are integrated on a chip, the memory 901, the processor 902 and the communication interface 903 can communicate with each other through an internal interface.

[0104] The processor 902 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application.

[0105] This embodiment also provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the user operation guiding method based on user operation behavior as described above is implemented.

[0106] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or N embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0107] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of this application, "N" means at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0108] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0109] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purpose of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or N wirings (electronic devices), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.

[0110] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiment, the N steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0111] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0112] In addition, each functional unit in each embodiment of the present application may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0113] The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limiting the present application. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A user operation guidance method based on user operation behavior, characterized in that: The following steps are involved: Collect the current user's interactive action data on the physical interface; Extracting features from the interactive action data to obtain current action features, determining target action features of the current user at the next moment based on the current action features, and obtaining a sound feedback signal corresponding to the target action features from a preset action feature-sound signal table; as well as Playing the sound feedback signal to guide the current user to perform a next action on the physical interface through the played sound feedback signal; Wherein, determining the target action feature of the current user at the next moment according to the current action feature includes: determining a motion trajectory guide based on the corresponding relationship between the shape and the spatial position of the physical interface, and determining the target action feature of the current user at the next moment according to the motion trajectory guide and the current action feature; The current action features include action trajectory, touch position, touch strength and touch duration; Before obtaining the sound feedback signal corresponding to the target action feature from the preset action feature-sound signal table, the method further includes: determining a plurality of sound signals to be tested, wherein each sound signal to be tested includes tone, sound intensity and pitch; obtaining action feature sets of a plurality of target users under each sound signal to be tested based on the tone, sound intensity and pitch of each sound signal to be tested; eliminating the action features in the action feature set that meet the preset screening conditions to obtain the action features corresponding to each sound signal to be tested, and generating the preset action feature-sound signal table according to the action features corresponding to each sound signal to be tested; The interactive action data includes at least one of a deformation action, a displacement action and an instantaneous action.

2. A user operation guiding device based on user operation behavior, characterized in that: include: The collection module is used to collect the interactive action data of the current user on the physical interface; A feature extraction module is used to extract features from the interactive action data to obtain current action features, determine the target action features of the current user at the next moment according to the current action features, and obtain a sound feedback signal corresponding to the target action features from a preset action feature-sound signal table; as well as A guiding module, used for playing the sound feedback signal, so as to guide the current user to perform a next action on the physical interface through the played sound feedback signal; Wherein, determining the target action feature of the current user at the next moment according to the current action feature includes: determining a motion trajectory guide based on the corresponding relationship between the shape and the spatial position of the physical interface, and determining the target action feature of the current user at the next moment according to the motion trajectory guide and the current action feature; The current action features include action trajectory, touch position, touch strength and touch duration; Before obtaining the sound feedback signal corresponding to the target action feature from the preset action feature-sound signal table, the feature extraction module is further used to: determine a plurality of sound signals to be tested, wherein each sound signal to be tested includes tone, sound intensity and pitch; based on the tone, sound intensity and pitch of each sound signal to be tested, obtain a set of action features of a plurality of target users under each sound signal to be tested; eliminate the action features that meet the preset screening conditions in the action feature set to obtain the action features corresponding to each sound signal to be tested, and generate the preset action feature-sound signal table according to the action features corresponding to each sound signal to be tested; The interactive action data includes at least one of a deformation action, a displacement action and an instantaneous action.

3. An electronic device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the user operation guiding method based on user operation behavior as claimed in claim 1.

4. A computer-readable storage medium having a computer program stored thereon, characterized in that: The program is executed by a processor to implement the user operation guiding method based on user operation behavior as claimed in claim 1.

Images