Vibration reminding method, related device, computer storage medium

Abstract

The application discloses a vibration reminding method, related equipment and computer storage medium. The method comprises the following steps: obtaining a target play control from a multimedia interface; obtaining function indication information and control indication information of the target play control from at least two indication information of the target play control; the control indication information represents a mode adopted by the target play control when performing play control in the multimedia interface; performing vibration encoding processing on the target play control based on the function indication information to obtain function code information of the target play control; performing vibration encoding processing on the target play control according to the control indication information to obtain control code information of the target play control; and taking the function code information and the control code information as vibration code information of the target play control, so that the target play control selected can be reminded by vibration code information output, play control can be effectively performed, and the play of media data is prevented from being interrupted.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a vibration alert method, related equipment, and computer storage medium. Background Technology

[0002] With the continuous development of computer technology, media playback based on computer devices has become a current trend. To facilitate user control over media playback, reminders are typically provided for playback controls performed on the multimedia interface to prevent accidental operations. Currently, these reminders are implemented by screen reading of the multimedia interface. However, screen reading reminders often lead to playback interruptions. Therefore, how to effectively provide playback control reminders has become a current research hotspot. Summary of the Invention

[0003] This application provides a vibration alert method, related equipment, and computer storage medium, which can effectively control playback and prevent media data playback interruption.

[0004] On the one hand, embodiments of this application provide a vibration alert method, including:

[0005] Obtain the target playback control from the multimedia interface; the multimedia interface includes at least one playback control, and the target playback control refers to the playback control that has at least two indication information in the at least one playback control;

[0006] From at least two indication messages of the target playback control, obtain the function indication message and control indication message of the target playback control; the control indication message of the target playback control is used to indicate the method adopted by the target playback control when performing playback control in the multimedia interface;

[0007] Based on the function indication information, the target playback control is subjected to vibration encoding processing to obtain the function encoding information of the target playback control; and the target playback control is subjected to vibration encoding processing according to the control indication information to obtain the control encoding information of the target playback control.

[0008] The functional encoding information and the control encoding information are used as the vibration encoding information of the target playback control; wherein, the vibration encoding information is used to output corresponding vibrations to indicate that the target playback control has been selected through the output vibrations.

[0009] Furthermore, embodiments of this application provide a vibration alert device, comprising:

[0010] An acquisition unit is used to acquire a target playback control from a multimedia interface; the multimedia interface includes at least one playback control, and the target playback control refers to a playback control in which at least two indication information exist;

[0011] The acquisition unit is further configured to acquire, from at least two indication messages of the target playback control, the function indication message and the control indication message of the target playback control; the control indication message of the target playback control is used to indicate the method adopted by the target playback control when performing playback control in the multimedia interface;

[0012] The encoding unit is configured to perform vibration encoding processing on the target playback control based on the function indication information to obtain the function encoding information of the target playback control, and to perform vibration encoding processing on the target playback control according to the control indication information to obtain the control encoding information of the target playback control;

[0013] The processing unit is configured to use the function encoding information and the control encoding information as vibration encoding information of the target playback control; wherein the vibration encoding information is used to output corresponding vibrations to indicate that the target playback control has been selected through the output vibrations.

[0014] In another aspect, embodiments of this application provide a computer device, including a processor, an output device, and a memory, wherein the processor, output device, and memory are interconnected, wherein the memory is used to store a computer program that supports the computer device in executing the above-described method, the computer program including program instructions, and the processor is configured to invoke the program instructions to execute the following steps:

[0015] Obtain the target playback control from the multimedia interface; the multimedia interface includes at least one playback control, and the target playback control refers to the playback control that has at least two indication information in the at least one playback control;

[0016] From at least two indication messages of the target playback control, obtain the function indication message and control indication message of the target playback control; the control indication message of the target playback control is used to indicate the method adopted by the target playback control when performing playback control in the multimedia interface;

[0017] Based on the function indication information, the target playback control is subjected to vibration encoding processing to obtain the function encoding information of the target playback control; and the target playback control is subjected to vibration encoding processing according to the control indication information to obtain the control encoding information of the target playback control.

[0018] The functional encoding information and the control encoding information are used as the vibration encoding information of the target playback control; wherein, the vibration encoding information is used to output corresponding vibrations to indicate that the target playback control has been selected through the output vibrations.

[0019] In another aspect, embodiments of this application provide a computer storage medium storing program instructions, which, when executed by a processor, are used to perform the vibration alert method as described in the first aspect.

[0020] In this embodiment, the computer device can determine the function indication information and control indication information from at least two indication information contained in the target playback control. Based on these indications, the computer device can sequentially perform vibration encoding processing on the target playback control to obtain corresponding function encoding information and control encoding information. When the target playback control is selected, vibrations are output according to these indications to remind the user of the selection. This allows the computer device to effectively remind the selected playback control without interrupting media data playback in the multimedia interface. Furthermore, since the vibration encoding information of the target playback control is obtained by vibration encoding based on at least two indications, it contains rich information related to the playback control. This ensures that the vibration encoding information of different target playback controls is different, resulting in different vibrations output based on the vibration encoding information of different target playback controls. This allows the user to effectively distinguish between different playback controls based on the received vibrations, making the reminders from the computer device more accurate and effective, thus improving the accuracy of vibration reminders. Attached Figure Description

[0021] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0022] Figure 1a This is a schematic diagram of a control display area in a multimedia interface provided in an embodiment of this application;

[0023] Figure 1b This is a schematic flowchart illustrating how to display other playback controls based on a trigger operation of a playback control, as provided in an embodiment of this application.

[0024] Figure 1c This is a flowchart illustrating a method for triggering a playback control, as provided in an embodiment of this application.

[0025] Figure 2 This is a schematic flowchart of a vibration alert method provided in an embodiment of this application;

[0026] Figure 3 This is a schematic diagram illustrating the application process of a vibration alert method provided in an embodiment of this application;

[0027] Figure 4 This is a schematic flowchart of another vibration alert method provided in the embodiments of this application;

[0028] Figure 5a This is a flowchart illustrating the encoding of playback controls according to an embodiment of this application;

[0029] Figure 5b This is a schematic diagram of a modal control displayed in a control display area according to an embodiment of this application;

[0030] Figure 6a This is a schematic diagram of a tactile sensing array provided in an embodiment of this application;

[0031] Figure 6b This is a schematic diagram of a Braille spelling method provided in an embodiment of this application;

[0032] Figure 7 This is a flowchart illustrating a selection / cancellation operation for a playback control, provided in an embodiment of this application.

[0033] Figure 8 This is a schematic diagram of the structure of a vibration alert device provided in an embodiment of this application;

[0034] Figure 9 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Detailed Implementation

[0035] This application provides a vibration alert method. After obtaining a composite type target playback control from a multimedia interface, the computer device further obtains function indication information and control indication information from at least two indication information of the target playback control. Based on the obtained function indication information, vibration encoding is performed to obtain function encoding information of the target playback control, and based on the obtained control indication information, vibration encoding is performed to obtain control encoding information of the target playback control. Finally, the function encoding information and control encoding information are used as the vibration encoding information of the target playback control. Therefore, when the target playback control is selected, the vibration encoding information of the target playback control is used to output a corresponding vibration to remind the target playback control that it has been selected. This allows the computer device to provide playback control alerts without affecting media data playback on the multimedia interface, thereby improving the effectiveness and flexibility of the computer device's playback control alerts. Furthermore, since the vibration encoding information of the target playback control is obtained by vibration encoding based on at least two indication information, the encoding information of the target playback control is enriched. This ensures effective differentiation between the target playback control and other playback controls in the multimedia interface, allowing users to effectively distinguish between different playback controls in the multimedia interface based on the vibration output of the selected playback controls, thereby enhancing user stickiness of the multimedia interface. The multimedia interface refers to an interface that supports the playback of various multimedia data, which can be one or both video and audio data. To enhance the diversity of multimedia data playback on the multimedia interface, it can also display one or more playback controls for controlling the playback of multimedia data. A composite playback control refers to a playback control in the multimedia interface that contains at least two indication information. The target playback control mentioned in this embodiment refers to any one of the composite playback controls in the multimedia interface.

[0036] In one embodiment, the indication information refers to information used to describe the function of the target playback control, or information used to describe the playback control method of media data. That is to say, the indication information may specifically include function indication information used to describe the function of the control, and control indication information used to describe the control method. It can be understood that each playback control contained in the multimedia interface corresponds to a function of playing media data. In other words, each playback control in the multimedia interface contains a corresponding function indication information. Because multimedia interfaces may contain multiple playback controls with the same function, or even one playback control with multiple functions, encoding the corresponding playback controls solely based on their function encoding information still fails to effectively distinguish between different playback controls based on the vibration output. Multiple playback controls with the same function, and playback controls with multiple functions, can be considered as composite playback controls. Therefore, to enable users to effectively distinguish between different composite playback controls based on the vibration output after encoding, vibration encoding of these composite playback controls will not only refer to the function indication information of the corresponding playback control, but also incorporate the control indication information describing the playback control method of the composite playback control. Thus, the function encoding information obtained based on the function indication information and the control encoding information obtained based on the control indication information will be used as the vibration encoding information of the corresponding composite playback control.

[0037] In one embodiment, based on playback controls in a multimedia interface that can be effectively distinguished by function, the encoding process for the playback control can be completed directly based on the functional encoding information of the corresponding playback control. Based on the computer device's encoding process for each playback control in the multimedia interface, the corresponding user can directly distinguish each playback control based on the encoded vibration output. In one embodiment, the vibration encoding information obtained by the computer device regarding the playback controls specifies the vibration encoding parameters and their corresponding values ​​used when the computer device vibrates. Specifically, this vibration encoding information includes one or more vibration encoding parameters and their corresponding parameter values. The vibration encoding parameters can be one or more of vibration intensity, vibration frequency, and vibration duration. Based on each vibration encoding parameter and its corresponding value, the computer device can determine a corresponding vibration waveform and output vibration based on that waveform. Alternatively, the computer device can also directly output vibration based on the vibration encoding parameters and their corresponding values ​​contained in the vibration encoding information. In other words, outputting vibration based on vibration encoding information means driving the computer device's motor to vibrate according to the vibration encoding parameters and their corresponding values ​​specified in the vibration encoding information.

[0038] In one embodiment, the playback controls included in the multimedia interface include control components directly displayed in the control display area of ​​the multimedia interface, wherein the control display area may be as follows: Figure 1a As shown, the multimedia interface includes the following playback controls: Figure 1a Each of the controls shown, in addition, the playback control also includes a control component that is displayed based on the triggering of a playback control in the control display area. For example, the playback control included in the multimedia interface may also include... Figure 1b As shown, after selecting a list component that is directly displayed in the control display area, the component that is triggered to display it is as follows: Figure 1b The display shown is in the display area marked with 11.

[0039] Based on the playback controls displayed on the multimedia interface and the vibration encoding information set for each playback control, the computer device can output a corresponding vibration after the user selects a playback control, thus reminding the user of the currently selected playback control. The user can be a visually impaired user who can select playback controls by touching or selecting them sequentially. It should be noted that selecting a playback control means that the touch moves to the display position of the corresponding playback control. However, simply moving the touch to the display position does not trigger playback control of the multimedia interface; further confirmation (or selection confirmation) from the user is required before playback control is initiated. This secondary confirmation can be a touch release operation. The specific process is as follows: Figure 1c As shown, where, Figure 1c The wavy line marked with 12 indicates the vibration output of the playback control selected by the computer device based on touch movement. That is, after the play / pause control displayed in the control display area is selected, the computer device will output vibration based on the vibration encoding information of the play / pause control to remind the corresponding user that the play / pause control has been selected. If the user wants to control the multimedia interface based on the play / pause control, they can lift the touch. When the computer device receives the touch lift operation, it can perform playback control based on the function of the play / pause control.

[0040] In one embodiment, the user's secondary confirmation operation is generally performed based on the vibration output by the computer device, which determines that playback control using the corresponding playback control is required. If, after the computer device outputs vibration, it is determined that playback control is not required, the user can continue to move the touch to a blank area of ​​the multimedia interface (i.e., an area where no playback control is displayed) to cancel the selection of the corresponding playback control. In one embodiment, the computer device can be a terminal device, which may include, but is not limited to, any one or more of the following: mobile phones, computers (e.g., tablets, laptops, desktop computers, etc.), in-vehicle terminals, intelligent voice interaction devices, smart home appliances (e.g., smart refrigerators, smart TVs, smart speakers, smart lights, etc.), aircraft, etc. In addition, the computer device can also be a server, which can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. Alternatively, the server can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. Furthermore, the computer device can also be a built-in processor in a server or a built-in processor in a terminal device, or an external processing device.

[0041] Please see Figure 2 This is a schematic flowchart illustrating a vibration alert method proposed in an embodiment of this application. This method can be executed by the aforementioned computer device, such as... Figure 2 As shown, the method may include:

[0042] S201. Obtain the target playback control from the multimedia interface. The multimedia interface includes at least one playback control. The target playback control refers to a playback control that contains at least two indication messages.

[0043] In one embodiment, the target playback control is any one of the composite types of playback controls included in the multimedia interface. A playback control is a component that can be used to control the playback of media data in the multimedia interface. To achieve effective playback control of the multimedia interface, multiple playback controls with different control functions can be displayed in the multimedia interface. Based on the different control functions of the multimedia interface, the playback controls displayed in the multimedia interface mostly include one or more of the following categories: playback function class, progress bar class, list control class, and list name (e.g., playlist) class. Specifically, the playback control of the playback function class can be a control that controls the playback of the previous media data, a control that controls the playback of the next media data, or a control that pauses or starts media data playback. The progress bar class can specifically be a control that supports fast progress jumping or a control that supports progress dragging. Furthermore, the playback control of the list control class can specifically be a mode control that supports switching between different playback modes, and the playback control of the list name class can be a list control or a media data name control.

[0044] A multimedia interface contains multiple playback controls. For playback controls with a single control function, the corresponding operation object can directly distinguish the control status of the multimedia interface based on the corresponding control function. Therefore, playback controls that can be distinguished based on the control status of the multimedia interface based on the corresponding control function can be called single-type playback controls. Playback controls that cannot be directly distinguished based on the control function can be called composite-type playback controls. In one embodiment, the composite-type playback control can specifically be the aforementioned media data name control or mode control, while the single-type playback control can be the aforementioned progress bar type playback control or play / pause control, etc. Since single-type playback controls can be distinguished based on their control functions, the computer device can directly perform vibration encoding on different single-type playback controls based on their corresponding function indication information when performing vibration encoding on them. However, since composite-type playback controls cannot be distinguished solely based on their control functions, the computer device, when performing vibration encoding on composite-type playback controls, needs to refer not only to the function indication information of the corresponding composite-type playback control but also to other indication information of the composite-type playback control. Therefore, vibration encoding is performed based on multiple different indication information to obtain the corresponding vibration encoding information. In other words, a composite-type playback control refers to a playback control with two corresponding indication information, and based on these two indication information, different composite-type playback controls can be effectively distinguished.

[0045] In one embodiment, a composite playback control includes at least two types of indication information, in addition to functional indication information, one or more control indication information indicating the method by which the user instructs the corresponding composite playback control to control the playback of the multimedia interface. This playback control method refers to the means employed to control playback on the multimedia interface. For example, if the composite playback control is a modal control, then the control indication information indicates which loop mode is used when controlling playback on the multimedia interface. Therefore, based on the vibration encoding processing of the functional and control indication information of the composite playback control, the corresponding operating object can effectively distinguish between composite playback controls. For single-type playback controls, even if the operating object can directly and effectively distinguish between different single-type playback controls based on their control functions, to further enhance the diversity of vibration-based alerts for single-type playback controls, the computer device can also use the method by which a single-type playback control controls the playback of the multimedia interface as the functional indication information for that single-type playback control, and then use this functional indication information to perform vibration encoding processing on the corresponding single-type playback control. If a single type of playback control is a progress bar, it can not only be coded based on the functionality of the progress bar, but also on the playback control method: that is, controlling the jump to the media data at the corresponding time and encoding vibration for the progress bar. In other words, any playback control in this multimedia interface can be regarded as a composite type of playback control.

[0046] S202. Obtain the function indication information and control indication information of the target playback control from at least two indication information of the target playback control; the control indication information of the target playback control is used to indicate the method adopted by the target playback control when performing playback control in the multimedia interface.

[0047] The function indication information of the target playback control is used to perform vibration encoding on the target playback control to obtain function encoding information. This function encoding information is used to output vibration to remind the user of the control function of the selected target playback control. Conversely, the control indication information is used to perform vibration encoding on the target playback control to obtain corresponding control encoding information. This control encoding information can be used to drive the computer device to output vibration to prompt the user of the control method adopted by the selected target playback control when performing playback control in the multimedia interface. Since in practical applications, the user can effectively distinguish different playback controls based on the function indication information and the control indication information, this allows the user to effectively differentiate the target playback control from other playback controls after the computer device performs vibration encoding processing on the target playback control based on this information.

[0048] In one embodiment, since the target playback control contains at least one functional indication and one or more control indications among the at least two indications, when the computer device performs vibration encoding processing on the functional and control indications obtained from the at least two indications of the target playback control, it will obtain one functional indication and part or all of the one or more control indications, and then perform vibration encoding processing on the target playback control based on the obtained functional and control indications. Wherein, when the target playback control is a mode control, the one or more control indications included in the mode control include: information indicating the current loop mode and information indicating the next loop mode. Then, the computer device can encode the mode control based solely on the functional indication and the indication indicating the current loop mode (i.e., the two indications), or it can encode the mode control based solely on the functional indication and the indication indicating the next loop mode, or it can encode the mode control based on all three indications: the functional indication, the indication indicating the current loop mode, and the indication indicating the next loop mode.

[0049] S203. Based on the function indication information, perform vibration encoding processing on the target playback control to obtain the function encoding information of the target playback control, and perform vibration encoding processing on the target playback control according to the control indication information to obtain the control encoding information of the target playback control.

[0050] S204. The function coding information and control coding information are used as the vibration coding information of the target playback control. The vibration coding information is used to output corresponding vibrations so as to indicate that the target playback control has been selected through the output vibrations.

[0051] In steps S203 and S204, the vibration coding process based on functional indication information and control indication information, respectively, is the process of determining the corresponding vibration coding parameters and their corresponding values ​​based on the functional indication information and control indication information, respectively. The vibration coding parameters can be one or more of vibration intensity, vibration frequency, and vibration duration. Therefore, the vibration coding information obtained by the computer device can include one or more vibration coding parameters and their corresponding values. It can be understood that based on the vibration coding parameters and their corresponding values ​​contained in the vibration coding information, the computer device can determine the corresponding vibration waveform and then output vibration based on that waveform. Alternatively, the vibration coding parameters and their corresponding values ​​contained in the vibration coding information can also be stored in a vibration description file, allowing the computer device to output vibration based on the parameters and their corresponding values ​​specified in the vibration description file.

[0052] After the computer device stores the vibration coding parameters and corresponding parameter values ​​contained in the vibration coding information as a vibration description file, the vibration coding parameters and corresponding parameter values ​​can be described in the vibration description file using the code shown below.

[0053]

[0054] In one embodiment, if the target playback control is a mode control, and the current playback control method for the multimedia interface is random playback, and if the vibration waveform indicated by the function encoding information determined by the computer device based on the function indication information of the mode control is a short, strong vibration waveform, with corresponding vibration encoding parameters and values ​​of: vibration intensity 90, vibration frequency 20Hz, and vibration duration 50ms, then the description of the function encoding information in the vibration description file of the mode control can be: 17{90, 20, 50}. Further, since the current playback control method for the multimedia interface is random loop playback, the control encoding information generated by the computer device based on the control indication information may include three high-frequency short vibrations, where the vibration encoding parameters and values ​​corresponding to each high-frequency short vibration are: vibration intensity 50, vibration frequency 80Hz, and vibration duration 100ms. Therefore, the encoding information recorded in the vibration description file specifically encoded by the mode control is as follows:

[0055] 17{90, 20, 50} / / Used to represent a short, strong vibration waveform, indicating that this is a mode control.

[0056] {0,0,100} / / Vibration interval 100ms. The vibration interval can be any other non-negative value, such as 0ms.

[0057] {50,80,100}{0,0,100}

[0058] {50,80,100}{0,0,100}

[0059] {50,80,100} / / Used to represent three consecutive high-frequency short vibrations, indicating that the current cycle mode is a random cycle mode.

[0060] In one embodiment, when a computer device performs vibration encoding processing on a target playback control based on functional indication information, it is necessary to ensure that the functional encoding information obtained by encoding different functional indication information is different. In order to make the functional encoding information obtained by the computer device when encoding playback controls with different functional indication information different, for example, the computer device can set vibration waveforms for each playback control in the multimedia interface according to the vibration encoding rules shown in Table 1.

[0061] Table 1

[0062]

[0063] Based on the vibration coding rules shown in Table 1, it can be seen that the computer device uses three vibration coding parameters—vibration intensity, vibration frequency, and vibration duration—and their corresponding values ​​to describe the vibration waveform. This means that the vibration coding rules in Table 1 can be understood as follows: the computer device generates vibration waveforms for the corresponding playback controls according to these three vibration coding parameters and their corresponding values. For example, for the "Previous Track" control in the multimedia interface, the computer device generates the vibration waveform for the "Previous Track" control with a vibration intensity of 20, a vibration frequency of 90Hz, and a vibration duration of 50ms. As shown in Table 1, the computer device sets different vibration waveforms for playback controls with different functions, allowing the computer device to output different vibrations based on these waveforms. This increases the difference in tactile perception between different playback controls, enabling users to distinguish between them based on the different vibrations they output, effectively improving the user experience.

[0064] In one embodiment, after obtaining the function encoding information and control encoding information of the target control, the computer device can directly use these two encoding information as the vibration encoding information of the target playback control and output vibration alerts according to these two encoding information respectively. In other embodiments, the computer device can also first concatenate the two encoding information, and then use the concatenated encoding information as the vibration encoding information of the target playback control and output vibration alerts according to the concatenated encoding information. In one embodiment, the concatenation process of the function encoding information and control encoding information by the computer device is the process of adding a corresponding vibration interval between the vibration of the function encoding information and the control encoding information. The added vibration interval can be 100ms or 50ms, etc. Based on the addition of the vibration interval, the corresponding operation can be used to effectively distinguish different vibrations output by the computer device, thereby improving the effectiveness of the corresponding vibration output.

[0065] In one embodiment, the process by which the computer device encodes the instruction information of the playback control in the multimedia interface to obtain the corresponding encoded information of the playback control can be performed after the computer device detects that the playback control has been touched. In this case, the process by which the computer device outputs the vibration corresponding to the playback control can be exemplarily described in [reference needed]. Figure 3As shown. After the computer device receives a touch operation, it determines the type of the playback control to which the touch operation was performed (e.g., single type or composite type), and then selects the appropriate encoding processing method to encode it to obtain vibration encoding information according to the type of the playback control. Then, the computer device outputs corresponding vibration based on the vibration encoding information to complete the response to the touch operation.

[0066] In this embodiment, the computer device can determine the function indication information and control indication information from at least two indication information contained in a composite type target playback control. Based on these indications, the computer device can sequentially perform vibration encoding processing on the target playback control to obtain corresponding function encoding information and control encoding information. When the target playback control is selected, vibrations are output according to these indications to remind the user of the selection. This allows the computer device to effectively remind the selected playback control without interrupting media data playback in the multimedia interface. Furthermore, since the vibration encoding information of the target playback control is obtained by vibration encoding based on at least two indications, it contains rich information related to the playback control. This ensures that the vibration encoding information of different target playback controls is different, resulting in different vibrations output based on the vibration encoding information of different target playback controls. This allows the user to effectively distinguish between different playback controls based on the received vibrations, making the prompts from the computer device more accurate and effective, thus improving the accuracy of the vibration reminders.

[0067] Please see Figure 4 , Figure 4 This is a schematic flowchart illustrating another vibration alert method provided in an embodiment of this application. Figure 4 As shown, the method may include:

[0068] S401. Obtain the target playback control from the multimedia interface. The multimedia interface includes at least one playback control. The target playback control refers to a playback control that contains at least two indication messages.

[0069] In one embodiment, when the playback controls included in the multimedia interface are categorized according to the number of instruction information they contain, the playback controls in the multimedia interface can be divided into two types: composite playback controls and single-type playback controls. Composite playback controls contain at least two instruction information items, while single-type playback controls contain only one instruction information item. Generally, modal controls and name controls in the multimedia interface are typically considered composite playback controls, while other playback controls besides modal and name controls are considered single-type playback controls. That is, in general, the target playback control is either a modal control or a name control.

[0070] In one embodiment, the method by which the computer device acquires the target playback control can be combined with... Figure 5a The flowchart shown is for reference. Specifically, when any playback control in the multimedia interface is selected, the computer device can identify the playback control to determine whether it is a modal control. If the computer device determines that the playback control is a modal control, it can use the playback control as the target playback control for vibration encoding processing to obtain the corresponding vibration encoding information, or further, after detecting a trigger operation targeting the target playback control, output the corresponding vibration effect based on the vibration encoding information. Conversely, if the computer device determines that the playback control is not a modal control, it can instead determine whether the playback control is a name control. If the computer device determines that the playback control is a name control, it uses the playback control as the target playback control to perform vibration encoding processing to obtain the corresponding vibration encoding information, or further output the corresponding vibration effect.

[0071] S402. Obtain the function indication information and control indication information of the target playback control from at least two indication information of the target playback control; the control indication information of the target playback control is used to indicate the method adopted by the target playback control when performing playback control in the multimedia interface.

[0072] In one embodiment, when the target playback control is a mode control, the mode control may specifically include one function indicator and at least one control indicator among its at least two indications. The function indicator indicates that when the mode control is selected, the computer device switches between one or more loop modes supported by the multimedia interface. The loop modes supported by the multimedia interface refer to modes in which the computer device loops media data added to the playlist. The one or more loop modes supported by the multimedia interface may include some or all of the following: a single loop mode, a list loop mode, and a random loop mode. Specifically, a single loop mode loops the media data currently being played by the multimedia interface; a list loop mode loops the media data according to its playback order in the corresponding playlist; and a random loop mode switches from the currently playing media data to any other media data in the playlist. The control indicator for the mode control may include one or both of the following:

[0073] (1) Use the loop mode currently indicated by the mode control in the multimedia interface to control playback in the multimedia interface.

[0074] (2) Use the next loop mode indicated by the mode control in the multimedia interface to control playback in the multimedia interface.

[0075] When a multimedia interface supports multiple loop modes, the switching order of these loop modes can be predetermined. In this case, the computer can encode only the currently indicated loop mode as function indication information. Alternatively, the switching order of the multiple loop modes supported by the multimedia interface can be unordered. In this case, the mode control can encode the currently indicated loop mode and / or the next loop mode as function indication information. The mode control can be, for example, as shown below. Figure 5b The control is marked with a 501 error. Alternatively, the target playback control can be a name control, which corresponds to media data in the multimedia interface. Media data in the multimedia interface refers to media data that can be played on the multimedia interface, not specifically the media data currently being displayed, such as the media data currently being played. The name control can have at least two indicators: a function indicator and a control indicator. The function indicator indicates that when the name control is selected, the computer device controls the multimedia interface to play the media data corresponding to the name control. The control indicator indicates that the computer device controls playback in the multimedia interface by playing the media data corresponding to the name control.

[0076] S403. Based on the function indication information, perform vibration encoding processing on the target playback control to obtain the function encoding information of the target playback control, and perform vibration encoding processing on the target playback control according to the control indication information to obtain the control encoding information of the target playback control.

[0077] In one embodiment, when the target playback control is a mode control, the control encoding information corresponding to the mode control may include mode encoding information. This mode encoding information is related to the loop mode indicated by the mode control. That is, when the mode control indicates different loop modes, the control encoding information generated by the computer device should be different, enabling the computer device to control the multimedia interface device to output different vibrations, thereby assisting the user in accurately distinguishing the different functions performed by the mode control based on the vibration. The mode encoding information can also be used to indicate vibration encoding parameters and their corresponding values. Conversely, mode encoding information can be generated based on vibration encoding parameters. Therefore, the computer device can further generate mode encoding information by setting vibration encoding parameters and their values. Since the mode encoding information is related to the loop mode indicated by the mode control, the vibration encoding parameters set by the computer device for the mode control can be related to the loop mode indicated by the mode control. The loop mode indicated by the mode control can be any one of one or more supported loop modes. Therefore, it's easy to understand that a computer device can pre-set corresponding vibration encoding parameters and values ​​for any supported loop mode. This allows the computer to generate corresponding mode encoding information for the mode control by acquiring these parameters and values. The computer device can output vibration by generating a corresponding vibration waveform based on the vibration encoding parameters and values ​​in the encoding information, and then outputting vibration based on the waveform. To facilitate rapid vibration output after detecting a selection operation on the playback control, the computer device can also directly generate a vibration waveform based on the vibration encoding parameters and values ​​after acquiring them. This allows the encoding information to include the vibration waveform, or it can generate mode encoding information based on the vibration waveform. Therefore, in one implementation, the computer device can specifically generate mode encoding information corresponding to any loop mode in the following way: the computer device acquires the vibration encoding parameters and corresponding values ​​set for that loop mode, and generates a target vibration waveform corresponding to that loop mode based on the acquired parameters and values, so that the computer device can generate mode encoding information corresponding to that loop mode based on the target vibration waveform.

[0078] Since single loop mode, list loop mode, and random loop mode are essentially all used to express the looping pattern of media data during playback, in order to reduce the complexity of the encoded information and the workload of the computer device during vibration encoding, the computer device can set the same vibration encoding parameters for different loop modes, so that different loop modes can be represented based on the same target vibration waveform. However, to facilitate the differentiation of different loop modes, the computer device can set different numbers of target vibration waveforms for different loop modes, so that the pattern encoding information generated by the computer device based on different loop modes is represented by different numbers of target vibration waveforms. For example, the target vibration waveform is set as a high-frequency short vibration waveform, which can be described by a vibration intensity of 50, a vibration frequency of 80 Hz, and a vibration duration of 100 ms. Based on this, for the single loop mode, list loop mode, and random loop mode in the loop mode, the computer device can set one target vibration waveform for the single loop mode, two target vibration waveforms for the list loop mode, and three target vibration waveforms for the random loop mode.

[0079] Of course, in other implementations of this application, the computer device can also set different vibration coding parameters for different loop modes so that the computer device can generate different target vibration waveforms for different loop modes. The computer device can also further set different numbers of target vibration waveforms for different loop modes to increase the distinction between the pattern coding information generated by different loop modes. The embodiments of this application do not limit or elaborate on this.

[0080] Therefore, it can be understood that the mode encoding information in this embodiment is obtained based on the target vibration waveform of the corresponding loop mode, and each loop mode has a preset number of target vibration waveforms. Thus, for any loop mode among one or more loop modes supported by the multimedia interface, when generating mode encoding information corresponding to that loop mode, the computer device should obtain the number of target vibration waveforms required for that loop mode (or: the number of target vibration waveforms required to generate the corresponding mode encoding information), so that the computer device can use the corresponding number of target vibration waveforms as the mode encoding information for that loop mode, thereby generating different mode encoding information for different loop modes.

[0081] In the process of the computer device using a corresponding number of target vibration waveforms as the mode coding information corresponding to any cyclic mode, if the number of target vibration waveforms required to generate the mode coding information is multiple, the computer device can combine these multiple target vibration waveforms at a certain time interval and then use them as the mode coding information for any cyclic mode. For example, when a computer device needs three target vibration waveforms to generate the pattern encoding information corresponding to a random cyclic pattern, and the target vibration waveforms are high-frequency short vibration waveforms with a vibration intensity of 50, a vibration frequency of 80 Hz, and a vibration duration of 100 ms, the pattern encoding information corresponding to the random cyclic pattern can be obtained by combining the three high-frequency short vibration waveforms. A vibration interval waveform can exist between every two high-frequency short vibration waveforms to add a 100 ms time interval between them. In this case, the pattern encoding information can specifically be: {50,80,100}{0,0,100}{50,80,100}{0,0,100}{50,80,100}, where {50,80,100} indicates the high-frequency short vibration waveform, and {0,0,100} indicates the vibration interval waveform. Of course, in other implementations, the computer device can also directly use multiple acquired target vibration waveforms as the pattern encoding information corresponding to any cyclic pattern. This application embodiment does not limit or elaborate on this.

[0082] In one embodiment, when the target playback control is a name control, the control encoding information of the target playback control may include the name encoding information of the media data corresponding to the name control. The computer device obtains the name encoding information of the name control as follows: the computer device acquires the data name of the media data corresponding to the name control and determines one or more tactile sensing arrays corresponding to that data name. Then, the computer device encodes each tactile sensing array according to the expression state of each sensing point in each tactile sensing array to obtain the name encoding information of the media data corresponding to that data name. The data name of the media data may be, for example, the song title, the movie title, the title of a music video (MV), or the artist's name or song title, etc. In obtaining the name encoding information, the computer device may encode each character contained in the data name to obtain the encoding information corresponding to the corresponding character, and then use the encoding information of all the characters contained in the data name as the name encoding information corresponding to that data name. It should be noted that when a computer device uses the encoded information of multiple representative characters as name encoding information, it can add vibration interval information (or information interval) between the encoded information corresponding to different representative characters. The vibration interval information is used to output the vibration time interval, allowing users to more easily distinguish different representative characters based on the perceived vibration time interval, effectively improving the user experience. For the computer device, adding the vibration interval waveform also facilitates the detection of the accuracy of the generated encoded information, effectively improving the processing efficiency of the computer device.

[0083] The media data name can contain one or more character representations, and each character representation can be represented by the expression state corresponding to each sensor point in one or more tactile sensing arrays. Character representations can include one or more of the following: Chinese characters, letters, and numbers. A tactile sensing array can be exemplarily shown as... Figure 6a As shown, it is easy to see that the tactile sensing array can be composed of 6 points arranged in a certain pattern. Each point is a sensing point, and each sensing point has a corresponding expression state. For example, the expression state of a sensing point can be a convex state (a black point in the tactile sensing array, such as the sensing point marked 601) or a concave state (a white point in the tactile sensing array, such as the sensing point marked 602). In specific implementation, the tactile sensing array can be determined according to the Braille spelling of the corresponding character. For example, when the character is a Chinese character, the Braille spelling of the character can be determined according to the Braille spelling corresponding to the Pinyin of the Chinese character. Some Braille spelling methods can be found in [reference needed]. Figure 6b As shown.

[0084] In one implementation of this embodiment, the computer device can encode any tactile perception array as follows: The computer device first obtains the composition method of each perception point in the tactile perception array. The composition method can indicate one or more of the following information: how many perception points the tactile perception array consists of, the expression state of each perception point, and the arrangement method (or: relative position relationship) between each perception point. After obtaining the composition method, the computer device can sequentially number each perception point in the tactile perception array based on the composition method to obtain the serial number corresponding to each perception point. For example, for Figure 6a the tactile perception array shown, the computer device can divide it into two columns, and then sequentially number each perception point in the left column ( Figure 6a the column marked 61 in) from top to bottom as 1, 2, 3; correspondingly, for each perception point in the right column ( Figure 6a the column marked 60 in), number them from top to bottom as 4, 5, 6. In this case, the computer device can further obtain the serial numbers corresponding to the perception points with the expression state of the protruding state according to the expression states of each perception point in the tactile perception array, so that the computer device can encode the tactile perception array based on the obtained serial numbers. Optionally, the computer device obtains the serial numbers corresponding to the perception points with the expression state of the concave state to encode the tactile perception array based on the obtained serial numbers. This application embodiment does not limit this, but the following will be described by taking the protruding state as an example.

[0085] The following will describe in detail an implementation of the computer device generating encoded information representing characters in combination with specific examples. Assume that the data name includes the character Hu (pinyin: hu). Then, Hu can be represented by the tactile perception array corresponding to the pinyin h and the tactile perception array corresponding to the pinyin u. According to Figure 6b the Braille spelling method shown, the serial numbers of the perception points with the expression state of the protruding state in the tactile perception array corresponding to h include 1, 2, and 5, and the serial numbers of the perception points with the expression state of the protruding state in the tactile perception array corresponding to u include 1, 3, and 6. Then, the computer device can encode the character based on the serial numbers in the serial number sequence (1, 2, 5) and the serial numbers in the serial number sequence (1, 3, 6) to obtain the encoded information of the character Hu.

[0086] In another implementation of this embodiment, the composition method of each perception point in any tactile perception array can be a two-row and three-column composition method (that is: Figure 6a(The diagram shows the configuration of each sensing point in the tactile sensing array). Furthermore, the computer device can set a vibration coding parameter for each row of sensing points. This vibration coding parameter can be any one of vibration intensity, vibration frequency, and vibration duration. The vibration coding parameters set for sensing points in different rows are different, and the parameter values ​​set for different expression states of the same sensing point are also different. For example, the vibration coding parameters and corresponding parameter values ​​set by the computer device for each sensing point can be as follows:

[0087] (1) First row of sensing points (i.e., sensing points numbered 1 and 4): The vibration coding parameter set by the computer device is vibration intensity. When the expression state of any of the sensing points is convex, the parameter value indicated by that sensing point is 80. When the expression state of any of the sensing points is concave, the parameter value indicated by that sensing point is 20. The reverse is also true.

[0088] (2) Second row of sensing points (i.e., sensing points numbered 2 and 5): The vibration coding parameter set by the computer device is the vibration frequency. When the expression state of any of the sensing points is convex, the parameter value indicated by that sensing point is 100 Hz. When the expression state of any of the sensing points is concave, the parameter value indicated by that sensing point is 300 Hz. The reverse is also true.

[0089] (3) The third row of sensing points (i.e., sensing points numbered 3 and 6): The vibration coding parameter set by the computer device is the vibration duration. When the expression state of any of the sensing points is convex, the parameter value indicated by that sensing point is 300ms. When the expression state of any of the sensing points is concave, the parameter value indicated by that sensing point is 100ms. The reverse is also true.

[0090] In this case, the computer device can encode any tactile sensing array as follows: The computer device obtains the vibration coding parameters set for each row of sensing points in the tactile sensing array, and determines the parameter values ​​corresponding to the vibration coding parameters set for the sensing points in the corresponding row based on the expression state of each row of sensing points in the tactile sensing array. This allows the computer device to generate reference vibration waveforms for the corresponding columns based on the vibration coding parameters and corresponding parameter values ​​for each sensing point in the same column. The computer device uses the reference vibration waveforms generated for each column of sensing points as the coding information corresponding to the tactile sensing array, so that the computer device can use the coding information corresponding to all tactile sensing arrays obtained based on the data name as name coding information.

[0091] For ease of understanding, the following also takes the character "Hu" in Chinese as an example to illustrate another implementation method of the computer device for encoding processing based on the represented character. Since in the tactile perception array corresponding to "h", the first and second rows of the three rows of perception points in the left column are in a convex state, and the third row of perception points is in a concave state, therefore, the reference vibration waveform corresponding to the left column can be generated based on the vibration intensity of 80, the vibration frequency of 100 HZ, and the vibration duration of 100 ms; similarly, the reference vibration waveform corresponding to the perception points in the right column of the tactile perception array corresponding to "h" can be generated based on the vibration intensity of 20, the vibration frequency of 100 HZ, and the vibration duration of 100 ms. For the character "u", the reference vibration waveform corresponding to the perception points in the left column of the tactile perception array can be generated based on the vibration intensity of 80, the vibration frequency of 300 HZ, and the vibration duration of 300 ms, and the reference vibration waveform corresponding to the perception points in the right column of the tactile perception array corresponding to "u" can be generated based on the vibration intensity of 20, the vibration frequency of 300 HZ, and the vibration duration of 300 ms. In summary, the computer device can use the obtained 4 reference vibration waveforms as the encoding information of the Chinese character "Hu", and this encoding information can be represented by the following vibration description information:

[0092] {80, 100, 100}{20, 100, 100} / / Used to represent the Chinese pinyin "h"

[0093] {80, 300, 300}{20, 300, 300} / / Used to represent the Chinese pinyin "u"

[0094] S404. Obtain the information interval between the function encoding information and the control encoding information.

[0095] S405. Perform associated splicing on the function encoding information and the control encoding information according to the information interval, and use the associated spliced encoding information as the vibration encoding information corresponding to the target playback control. The vibration encoding information is used to output the corresponding vibration to indicate that the target playback control has been selected through the output vibration.

[0096] In one embodiment, in order to enable the computer device to accurately prompt the operating user which playback control in the multimedia interface the currently selected playback control is based on the vibration effect output according to the function coding information and the control coding information, the computer device may add an information interval between the function coding information and the control coding information, so that the vibration effect output based on the vibration coding information by the computer device can have a vibration interval effect. For example, assume that the target playback control is a name control, and the data name of the media data corresponding to the name control is "童". Then, based on Table 1, it can be known that the function coding information corresponding to the name control can be represented by {50, 30, 200}{50, 30, 200}. Also, based on the description in step S403, it is not difficult to obtain that in the data name corresponding to the name control, the coding information representing the character "童" can be represented by {20, 100, 300}{80, 100, 100}{20, 100, 100}{20, 100, 300}. Then, optionally, the name coding information corresponding to the data name "童" can be represented by the following vibration description file:

[0097] {50, 30, 200}{50, 30, 200} / / Represents the name control

[0098] {0, 0, 100} / / Represents the information interval (or vibration time interval), and the description of the data name is carried out after the information interval

[0099] {20, 100, 300}{80, 100, 100}{20, 100, 100}{20, 100, 300} / / Represents the character "童"

[0100] In one embodiment, based on the above regarding Figure 2 and Figure 4The vibration alert method shown should be explained in that, in addition to vibration encoding of composite-type target playback controls, the computer device can also perform vibration encoding of single-type reference playback controls in the multimedia interface. The following describes how the computer device obtains the vibration encoding information of the reference playback control. Specifically, the computer device can acquire a single-type reference playback control in the multimedia interface and, based on the function of the reference playback control, obtain its function indication information. A reference playback control refers to any one of the single-type playback controls included in the multimedia interface. The function indication information of the reference playback control indicates its role in playback control within the multimedia interface. After acquiring the function indication information of the reference playback control, the computer device can perform vibration encoding processing based on this information to obtain function encoding information, which serves as the vibration encoding information of the reference playback control. Note that the vibration encoding information of any two reference playback controls in the multimedia interface of the computer device is different. In a specific implementation, the computer device can also set a vibration waveform for the reference playback control so that the computer device can use the vibration waveform of the reference playback control as the vibration encoding information of the reference playback control. The method of the computer device setting a vibration waveform for the reference playback control can be found in step S203, which describes the method of the computer device setting a functional vibration waveform for the target playback control. It will not be repeated here.

[0101] In one embodiment, the vibration alert method provided in this application can be applied to various vibration coding scenarios related to multimedia interfaces. Specifically, the applicable scenarios of this application may include, but are not limited to: scenarios where vibration coding is performed on music playback controls in an audio playback interface, and scenarios where vibration coding is performed on video playback controls in a video playback interface. Taking the vibration coding scenario corresponding to an audio playback interface as an example, that is, the interface used by the user is an audio playback interface. In this case, the computer device can use the vibration alert method provided in this application to perform vibration coding on the playback controls included in the audio playback interface to obtain corresponding vibration coding information. After the computer device detects a selection operation on any playback control in the audio playback interface, the computer device can obtain the vibration coding information of the playback control and output a corresponding vibration effect on the device used by the user based on the vibration coding information. This allows the user to know which playback control is currently selected when they perceive the corresponding vibration effect, and thus allows the user to perform a selection confirmation operation or a selection cancellation operation on the playback control according to their own needs, thereby triggering or canceling the execution of the corresponding playback control function. Among them, the selection cancellation operation may include, but is not limited to, one or two of the following: moving touch position operation (such as... Figure 7The gestures shown include canceling the selection, and lifting the touch when the current playback control (or any playback control) is not displayed in the multimedia interface. It should be noted that... Figure 7 The wavy symbols (such as the symbols marked by 701 and 702) are patterns drawn to facilitate a more intuitive understanding of the embodiments of this application. They are used to express the vibration effect output by the computer device based on vibration coding information on the device where the multimedia interface is located, and therefore cannot be regarded as a limitation on the multimedia interface.

[0102] In this embodiment, the computer device can generate different vibration coding information for each playback control in the multimedia interface based on different indication information. When the playback control can be distinguished based on its control function (i.e., when the playback control is of a single type), the computer device performs vibration coding based on the control function of the corresponding playback control to obtain corresponding vibration coding information. This results in differences in the vibration coding information of different playback controls. By only performing vibration coding based on control functions, the workload of the computer device can be effectively reduced, thereby saving computing resources. Furthermore, when the playback control cannot be distinguished based on control functions, the computer device performs vibration coding based on at least two indication information, which can ensure to a certain extent that the vibration coding information of different playback controls is different. Therefore, since this embodiment can generate different vibration coding information for different playback controls in the multimedia interface, the vibration effects output when different playback controls are selected can also be different. Therefore, when a user selects any playback control, different vibrations will alert them to this selection. This allows the user to recognize playback controls from a tactile perspective, broadening the dimensions of playback control recognition in the multimedia interface and reducing the difficulty of identification. Since users can recognize playback controls based on vibration effects, they no longer need to rely on the computer's screen reader function. This avoids the computer performing screen reading during media playback, reducing its workload and preventing users from being disturbed by the audio output of the screen reader, thus effectively improving the user experience.

[0103] Based on the description of the above-described vibration alert method embodiments, this application also proposes a vibration alert device, which can be a computer program (including program code) running in the aforementioned computer device. This vibration alert device can be used to perform actions such as... Figure 2 as well as Figure 4 For the vibration alert method shown, please refer to [link / reference]. Figure 8The vibration alert device includes: an acquisition unit 801, an encoding unit 802, and a processing unit 803.

[0104] The acquisition unit 801 is used to acquire a target playback control from a multimedia interface; the multimedia interface includes at least one playback control, and the target playback control refers to a playback control in which at least two indication information exist;

[0105] The acquisition unit 801 is further configured to acquire, from at least two indication messages of the target playback control, the function indication message and the control indication message of the target playback control; the control indication message of the target playback control is used to indicate the method adopted by the target playback control when performing playback control in the multimedia interface;

[0106] The encoding unit 802 is configured to perform vibration encoding processing on the target playback control based on the function indication information to obtain the function encoding information of the target playback control, and to perform vibration encoding processing on the target playback control according to the control indication information to obtain the control encoding information of the target playback control;

[0107] The processing unit 803 is used to use the function encoding information and the control encoding information as vibration encoding information of the target playback control; wherein, the vibration encoding information is used to output corresponding vibrations to indicate that the target playback control has been selected through the output vibrations.

[0108] In one embodiment, the function indication information is used to indicate the role of the target playback control in playing the media data on the multimedia interface. The target playback control also includes a name control, and a name control corresponds to a media data in the multimedia interface. The role of the name control in playing the media data on the multimedia interface is: when the name control is selected, it controls the multimedia interface to play the media data corresponding to the name control.

[0109] The control instruction information of the name control is used to indicate that playback control is performed on the multimedia interface by playing the media data corresponding to the name control in the multimedia interface.

[0110] In one embodiment, if the target playback control is a name control, the obtained control encoding information of the name control includes: the name encoding information of the media data corresponding to the name control; the encoding unit 802 can also be used to perform:

[0111] Obtain the data name of the media data corresponding to the name control, and determine one or more tactile sensing arrays corresponding to the data name; wherein, the data name contains one or more character representations, and each character representation is represented by the expression state corresponding to each sensing point in one or more tactile sensing arrays;

[0112] Based on the expression state of each sensing point in each tactile sensing array, each tactile sensing array is encoded to obtain the name encoding information of the media data corresponding to the data name.

[0113] In one embodiment, the representation state of a sensing point in any tactile sensing array is a convex state or a concave state, and the encoding unit 802 can also be used to perform:

[0114] Obtain the configuration of each sensing point in any of the tactile sensing arrays, and number each sensing point in any of the tactile sensing arrays sequentially based on the configuration to obtain the sequence number corresponding to each sensing point;

[0115] Based on the expression state of each sensing point in any tactile sensing array, the sequence number corresponding to the sensing point whose expression state is convex is obtained, and the tactile sensing array is encoded based on the obtained sequence number.

[0116] In one embodiment, the sensor points in any tactile sensing array are arranged in a three-row, two-column configuration, and the expression state of a sensor point in any tactile sensing array is either a convex state or a concave state; the encoding unit 802 can also be used to perform:

[0117] Obtain the vibration coding parameters set for each row of sensing points in any of the tactile sensing arrays; the vibration coding parameters set for each row of sensing points are any one of vibration intensity, vibration frequency and vibration duration, and the vibration coding parameters set for sensing points in different rows are different;

[0118] Based on the expression state of each row of sensing points in any tactile sensing array, determine the parameter value corresponding to the vibration coding parameter set for the sensing point of the corresponding row;

[0119] Based on the vibration coding parameters and corresponding parameter values ​​for each sensing point in the same column, a reference vibration waveform for the corresponding column is generated; wherein, the reference vibration waveform for each column is used as the coding information for any tactile sensing array.

[0120] In one embodiment, the function indication information is used to indicate the role of the target playback control in playing control on the multimedia interface. The target playback control includes a mode control, and the role of the mode control in playing control on the multimedia interface is to switch one or more loop modes supported by the multimedia interface when the mode control is selected.

[0121] The control indication information of the mode control is used to indicate one or both of the following: using the loop mode currently indicated by the mode control to perform playback control in the multimedia interface, and using the next loop mode indicated by the mode control to perform playback control in the multimedia interface.

[0122] In one embodiment, if the target playback control is a mode control, the obtained control encoding information of the mode control includes: mode encoding information corresponding to any loop mode among one or more loop modes supported by the multimedia interface; the encoding unit 802 can also be used to perform:

[0123] The vibration coding parameters and corresponding parameter values ​​set for one or more loop modes supported by the multimedia interface are obtained, and a target vibration waveform is generated based on the obtained vibration coding parameters and corresponding parameter values; the vibration coding parameters include one or more of vibration intensity, vibration frequency and vibration duration;

[0124] Based on the target vibration waveform, generate mode encoding information for any loop mode supported by the multimedia interface.

[0125] In one embodiment, the multimedia interface supports a looping mode based on media data added to the playlist. The multimedia interface supports one or more looping modes, including some or all of a single loop mode, a playlist loop mode, and a random loop mode. The encoding unit 802 can also be used to perform:

[0126] The number of target vibration waveforms required for any loop mode supported by the multimedia interface is obtained, wherein the number of target vibration waveforms required for different loop modes supported by the multimedia interface is different;

[0127] The corresponding number of target vibration waveforms are used as the mode encoding information for any of the cyclic modes.

[0128] In one embodiment, the processing unit 803 may specifically be used to perform:

[0129] Obtain the information interval between the functional coding information and the control coding information;

[0130] The functional encoding information and the control encoding information are associated and concatenated according to the information interval, and the associated and concatenated encoding information is used as the vibration encoding information corresponding to the target playback control.

[0131] In one embodiment, the processing unit 803 can also be used to perform:

[0132] Obtain a reference playback control of a single type in the multimedia interface, and based on the function of the reference playback control, obtain the function indication information of the reference playback control;

[0133] The function encoding information obtained by vibration encoding based on the function indication information of the reference playback control is used as the vibration encoding information of the reference playback control.

[0134] The multimedia interface contains multiple reference playback controls of a single type, and the vibration encoding information of any two reference playback controls is different.

[0135] In one embodiment, the acquisition unit 801 is specifically used to perform:

[0136] When any playback control in the multimedia interface is selected, it is determined whether the playback control is a modal control.

[0137] When any of the playback controls is determined to be a mode control, the any of the playback controls is determined to be the target playback control, and one or both of the current loop mode and the next loop mode in the multimedia interface are used as the control indication information of any of the playback controls;

[0138] Otherwise, when any of the playback controls is determined to be a name control, the any of the playback controls is determined to be the target playback control, and the data name of the media data indicated by the name control is used as the control indication information of the any of the playback controls.

[0139] In this embodiment, the acquisition unit 801 can determine the function indication information and control indication information from at least two indication information contained in the target playback control. This allows the encoding unit 802 to sequentially perform vibration encoding processing on the target playback control based on the function indication information and control indication information, obtaining corresponding function encoding information and control encoding information. Consequently, when the target playback control is selected, vibrations can be output according to the function encoding information and control encoding information respectively, to remind the user of the selection of the target playback control. This allows the vibration reminder device to effectively remind the selected playback control without interrupting media data playback in the multimedia interface. Furthermore, since the vibration encoding information of the target playback control is obtained by vibration encoding based on at least two indication information, it contains rich information related to the playback control. This ensures that the vibration encoding information of different target playback controls is different, thus guaranteeing that the vibrations output based on the vibration encoding information of different target playback controls are different. This allows the user to effectively distinguish different playback controls based on the received different vibrations, making the reminders issued by the computer device to the user more accurate and effective, thereby improving the accuracy of the computer device's vibration reminders.

[0140] Please see Figure 9 , Figure 9 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Figure 9 The computer device shown may include one or more processors 901 and a memory 902. The processors 901 and the memory 902 may establish a communication connection via a bus 903. The memory 902 is used to store computer programs, which include program instructions, and the processor 901 is used to execute the program instructions stored in the memory 902.

[0141] The memory 902 may include volatile memory, such as random-access memory (RAM); the memory 902 may also include non-volatile memory, such as flash memory, solid-state drive (SSD), etc.; the memory 902 may also include a combination of the above types of memory.

[0142] The processor 901 may be a central processing unit (CPU). The processor 901 may further include hardware chips. These hardware chips may be application-specific integrated circuits (ASICs), programmable logic devices (PLDs), etc. The PLD may be a field-programmable gate array (FPGA), generic array logic (GAL), etc. The processor 901 may also be a combination of the above structures.

[0143] In this embodiment, the memory 902 is used to store a computer program, which includes program instructions. The processor 901 is used to execute the program instructions stored in the memory 902 to implement the above-mentioned... Figure 2 as well as Figure 4 The steps of the corresponding method.

[0144] In one embodiment, the processor 901 is configured to invoke the program instructions to execute:

[0145] Obtain the target playback control from the multimedia interface; the multimedia interface includes at least one playback control, and the target playback control refers to the playback control that has at least two indication information in the at least one playback control;

[0146] From at least two indication messages of the target playback control, obtain the function indication message and control indication message of the target playback control; the control indication message of the target playback control is used to indicate the method adopted by the target playback control when performing playback control in the multimedia interface;

[0147] Based on the function indication information, the target playback control is subjected to vibration encoding processing to obtain the function encoding information of the target playback control; and the target playback control is subjected to vibration encoding processing according to the control indication information to obtain the control encoding information of the target playback control.

[0148] The functional encoding information and the control encoding information are used as the vibration encoding information of the target playback control; wherein, the vibration encoding information is used to output corresponding vibrations to indicate that the target playback control has been selected through the output vibrations.

[0149] In one embodiment, the function indication information is used to indicate the role of the target playback control in playing the media data on the multimedia interface. The target playback control also includes a name control, and a name control corresponds to a media data in the multimedia interface. The role of the name control in playing the media data on the multimedia interface is: when the name control is selected, it controls the multimedia interface to play the media data corresponding to the name control.

[0150] The control instruction information of the name control is used to indicate that playback control is performed on the multimedia interface by playing the media data corresponding to the name control in the multimedia interface.

[0151] In one embodiment, if the target playback control is a name control, the obtained control encoding information of the name control includes: the name encoding information of the media data corresponding to the name control; the processor 901 is configured to call the program instructions to execute:

[0152] Obtain the data name of the media data corresponding to the name control, and determine one or more tactile sensing arrays corresponding to the data name; wherein, the data name contains one or more character representations, and each character representation is represented by the expression state corresponding to each sensing point in one or more tactile sensing arrays;

[0153] Based on the expression state of each sensing point in each tactile sensing array, each tactile sensing array is encoded to obtain the name encoding information of the media data corresponding to the data name.

[0154] In one embodiment, the representation state of a sensing point in any tactile sensing array is either a convex state or a concave state, and the processor 901 is configured to invoke the program instructions to execute:

[0155] Obtain the configuration of each sensing point in any of the tactile sensing arrays, and number each sensing point in any of the tactile sensing arrays sequentially based on the configuration to obtain the sequence number corresponding to each sensing point;

[0156] Based on the expression state of each sensing point in any tactile sensing array, the sequence number corresponding to the sensing point whose expression state is convex is obtained, and the tactile sensing array is encoded based on the obtained sequence number.

[0157] In one embodiment, the sensor points in any tactile sensing array are arranged in a three-row, two-column configuration, and the state of a sensor point in any tactile sensing array is either a convex state or a concave state; the processor 901 is configured to call the program instructions to execute:

[0158] Obtain the vibration coding parameters set for each row of sensing points in any of the tactile sensing arrays; the vibration coding parameters set for each row of sensing points are any one of vibration intensity, vibration frequency and vibration duration, and the vibration coding parameters set for sensing points in different rows are different;

[0159] Based on the expression state of each row of sensing points in any tactile sensing array, determine the parameter value corresponding to the vibration coding parameter set for the sensing point of the corresponding row;

[0160] Based on the vibration coding parameters and corresponding parameter values ​​for each sensing point in the same column, a reference vibration waveform for the corresponding column is generated; wherein, the reference vibration waveform for each column is used as the coding information for any tactile sensing array.

[0161] In one embodiment, the function indication information is used to indicate the role of the target playback control in playing control on the multimedia interface. The target playback control includes a mode control, and the role of the mode control in playing control on the multimedia interface is to switch one or more loop modes supported by the multimedia interface when the mode control is selected.

[0162] The control indication information of the mode control is used to indicate one or both of the following: using the loop mode currently indicated by the mode control to perform playback control in the multimedia interface, and using the next loop mode indicated by the mode control to perform playback control in the multimedia interface.

[0163] In one embodiment, if the target playback control is a mode control, the obtained control encoding information of the mode control includes: mode encoding information corresponding to any loop mode among one or more loop modes supported by the multimedia interface; the processor 901 is configured to call the program instructions to execute:

[0164] The vibration coding parameters and corresponding parameter values ​​set for one or more loop modes supported by the multimedia interface are obtained, and a target vibration waveform is generated based on the obtained vibration coding parameters and corresponding parameter values; the vibration coding parameters include one or more of vibration intensity, vibration frequency and vibration duration;

[0165] Based on the target vibration waveform, generate mode encoding information for any loop mode supported by the multimedia interface.

[0166] In one embodiment, the multimedia interface supports a looping mode based on media data added to the playlist. The multimedia interface supports one or more looping modes, including some or all of a single loop mode, a playlist loop mode, and a random loop mode. The processor 901 is configured to call the program instructions to execute:

[0167] The number of target vibration waveforms required for any loop mode supported by the multimedia interface is obtained, wherein the number of target vibration waveforms required for different loop modes supported by the multimedia interface is different;

[0168] The corresponding number of target vibration waveforms are used as the mode encoding information for any of the cyclic modes.

[0169] In one embodiment, the processor 901 is configured to invoke the program instructions to execute:

[0170] Obtain the information interval between the functional coding information and the control coding information;

[0171] The functional encoding information and the control encoding information are associated and concatenated according to the information interval, and the associated and concatenated encoding information is used as the vibration encoding information corresponding to the target playback control.

[0172] In one embodiment, the processor 901 is configured to invoke the program instructions to execute:

[0173] Obtain a reference playback control of a single type in the multimedia interface, and based on the function of the reference playback control, obtain the function indication information of the reference playback control;

[0174] The function encoding information obtained by vibration encoding based on the function indication information of the reference playback control is used as the vibration encoding information of the reference playback control.

[0175] The multimedia interface contains multiple reference playback controls of a single type, and the vibration encoding information of any two reference playback controls is different.

[0176] In one embodiment, the processor 901 is configured to invoke the program instructions to execute:

[0177] When any playback control in the multimedia interface is selected, it is determined whether the playback control is a modal control.

[0178] When any of the playback controls is determined to be a mode control, the any of the playback controls is determined to be the target playback control, and one or both of the current loop mode and the next loop mode in the multimedia interface are used as the control indication information of any of the playback controls;

[0179] Otherwise, when any of the playback controls is determined to be a name control, the any of the playback controls is determined to be the target playback control, and the data name of the media data indicated by the name control is used as the control indication information of the any of the playback controls.

[0180] In this embodiment, the computer device can determine the function indication information and control indication information from at least two indication information contained in the target playback control. Based on these indications, the computer device can sequentially perform vibration encoding processing on the target playback control to obtain corresponding function encoding information and control encoding information. When the target playback control is selected, vibrations are output according to these indications to remind the user of the selection. This allows the computer device to effectively remind the selected playback control without interrupting media data playback in the multimedia interface. Furthermore, since the vibration encoding information of the target playback control is obtained by vibration encoding based on at least two indications, it contains rich information related to the playback control. This ensures that the vibration encoding information of different target playback controls is different, resulting in different vibrations output based on the vibration encoding information of different target playback controls. This allows the user to effectively distinguish between different playback controls based on the received vibrations, making the reminders from the computer device more accurate and effective, thus improving the accuracy of vibration reminders.

[0181] This application also provides a computer storage medium storing one or more computer programs corresponding to the above-described vibration alert method. When one or more processors load and execute the one or more computer programs, the vibration alert method described in the embodiments can be implemented, and will not be repeated here. The beneficial effects of using the same method will also not be repeated here. It is understood that the computer program can be deployed and executed on one or more devices capable of communicating with each other.

[0182] It should be noted that, according to one aspect of this application, a program product or computer program is also provided, the program product including a computer program stored in a computer storage medium. A processor in a computer device reads the computer program from the computer storage medium and then executes the computer program, thereby enabling the computer device to perform the aforementioned... Figure 2 and Figure 4 The vibration alert method is provided in various alternative ways in the embodiments shown.

[0183] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a computer storage medium, and when executed, it can include the processes of the embodiments of the vibration alert method described above. The computer storage medium can be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc.

[0184] The above-disclosed embodiments are merely partial examples of this application and should not be construed as limiting the scope of this application. Those skilled in the art will understand that implementing all or part of the above embodiments and making equivalent changes in accordance with the claims of this application are still within the scope of the invention.

Claims

1. A vibration alert method, characterized in that, include: Obtain the target playback control from the multimedia interface; the multimedia interface includes at least one playback control, and the target playback control refers to the playback control that has at least two indication information, the at least two indication information including function indication information and at least one control indication information; The step of obtaining the target playback control from the multimedia interface includes: When any playback control in the multimedia interface is selected, it is determined whether the playback control is a mode control. When any of the playback controls is determined to be a mode control, the any of the playback controls is determined to be the target playback control, and one or both of the current loop mode and the next loop mode in the multimedia interface are used as the control indication information of any of the playback controls; Otherwise, when any of the playback controls is determined to be a name control, the any of the playback controls is determined to be the target playback control, and the data name of the media data indicated by the name control is used as the control indication information of the any of the playback controls; From at least two indications of the target playback control, obtain the function indication information and control indication information of the target playback control; the function indication information is used to indicate the role of the target playback control in playing control on the multimedia interface, and the control indication information of the target playback control is used to indicate the method adopted by the target playback control when playing control on the multimedia interface; Based on the function indication information, the target playback control is subjected to vibration encoding processing to obtain the function encoding information of the target playback control; and based on the control indication information, the target playback control is subjected to vibration encoding processing to obtain the control encoding information of the target playback control. The functional encoding information and the control encoding information are used as the vibration encoding information of the target playback control; wherein, the vibration encoding information is used to output corresponding vibrations to indicate that the target playback control has been selected.

2. The method as described in claim 1, characterized in that, The target playback control also includes a name control, with each name control corresponding to a media data in the multimedia interface. The function of the name control in the multimedia interface for playback control is to control the multimedia interface to play the media data corresponding to the name control when the name control is selected. The control instruction information of the name control is used to indicate that playback control is performed on the multimedia interface by playing the media data corresponding to the name control in the multimedia interface.

3. The method as described in claim 1, characterized in that, If the target playback control is a name control, the control encoding information obtained for the name control includes: the name encoding information of the media data corresponding to the name control; the method for obtaining the name encoding information of the media data corresponding to the name control includes: Obtain the data name of the media data corresponding to the name control, and determine one or more tactile sensing arrays corresponding to the data name; wherein, the data name contains one or more character representations, and each character representation is represented by the expression state corresponding to each sensing point in one or more tactile sensing arrays; Based on the expression state of each sensing point in each tactile sensing array, each tactile sensing array is encoded to obtain the name encoding information of the media data corresponding to the data name.

4. The method as described in claim 3, characterized in that, The expression state of a sensing point in any tactile sensing array is either a convex state or a concave state; the encoding process for any tactile sensing array based on the expression state of each sensing point in the tactile sensing array includes: Obtain the configuration of each sensing point in any of the tactile sensing arrays, and number each sensing point in any of the tactile sensing arrays sequentially based on the configuration to obtain the sequence number corresponding to each sensing point; Based on the expression state of each sensing point in any tactile sensing array, the sequence number corresponding to the sensing point whose expression state is convex is obtained, and the tactile sensing array is encoded based on the obtained sequence number.

5. The method as described in claim 3, characterized in that, The sensor points in any tactile sensing array are arranged in a three-row, two-column configuration, and the expression state of a sensor point in any tactile sensing array is either a convex state or a concave state. The encoding process for any tactile sensing array based on the expression state of each sensing point in any tactile sensing array includes: Obtain the vibration coding parameters set for each row of sensing points in any of the tactile sensing arrays; the vibration coding parameters set for each row of sensing points are any one of vibration intensity, vibration frequency and vibration duration, and the vibration coding parameters set for sensing points in different rows are different; Based on the expression state of each row of sensing points in any tactile sensing array, determine the parameter value corresponding to the vibration coding parameter set for the sensing point of the corresponding row; Based on the vibration coding parameters and corresponding parameter values ​​for each sensing point in the same column, a reference vibration waveform for the corresponding column is generated; wherein, the reference vibration waveform for each column is used as the coding information for any tactile sensing array.

6. The method as described in claim 1, characterized in that, The target playback control includes a mode control. The function of the mode control in the multimedia interface is to switch one or more loop modes supported by the multimedia interface when the mode control is selected. The control indication information of the mode control is used to indicate one or both of the following: using the loop mode currently indicated by the mode control to perform playback control in the multimedia interface, and using the next loop mode indicated by the mode control to perform playback control in the multimedia interface.

7. The method as described in claim 1, characterized in that, If the target playback control is a mode control, the obtained control encoding information of the mode control includes: mode encoding information corresponding to any loop mode among one or more loop modes supported by the multimedia interface; the method of obtaining the mode encoding information of any loop mode includes: The vibration coding parameters and corresponding parameter values ​​set for one or more loop modes supported by the multimedia interface are obtained, and a target vibration waveform is generated based on the obtained vibration coding parameters and corresponding parameter values; the vibration coding parameters include one or more of vibration intensity, vibration frequency and vibration duration; Based on the target vibration waveform, generate mode encoding information for any loop mode supported by the multimedia interface.

8. The method as described in claim 7, characterized in that, The multimedia interface supports looping modes based on media data added to the playlist. One or more looping modes supported by the multimedia interface include some or all of the following: single loop mode, playlist loop mode, and random loop mode. Generating mode encoding information for any looping mode supported by the multimedia interface based on the target vibration waveform includes: The number of target vibration waveforms required for any loop mode supported by the multimedia interface is obtained, wherein the number of target vibration waveforms required for different loop modes supported by the multimedia interface is different; The corresponding number of target vibration waveforms are used as the mode encoding information for any of the cyclic modes.

9. The method as described in claim 1, characterized in that, The step of using the functional encoding information and the control encoding information as vibration encoding information for the target playback control includes: Obtain the information interval between the functional coding information and the control coding information; The function encoding information and the control encoding information are associated and concatenated according to the information interval, and the associated and concatenated encoding information is used as the vibration encoding information corresponding to the target playback control.

10. The method according to any one of claims 1-9, characterized in that, The method further includes: Obtain a reference playback control of a single type in the multimedia interface, and based on the function of the reference playback control, obtain the function indication information of the reference playback control; The function encoding information obtained by vibration encoding based on the function indication information of the reference playback control is used as the vibration encoding information of the reference playback control. The multimedia interface contains multiple reference playback controls of a single type, and the vibration encoding information of any two reference playback controls is different.

11. A vibration alert device, characterized in that, include: An acquisition unit is used to acquire a target playback control from a multimedia interface; the multimedia interface includes at least one playback control, and the target playback control refers to a playback control that has at least two indication information, the at least two indication information including function indication information and at least one control indication information; The acquisition unit, when acquiring the target playback control from the multimedia interface, is specifically used for: When any playback control in the multimedia interface is selected, it is determined whether the playback control is a mode control. When any of the playback controls is determined to be a mode control, the any of the playback controls is determined to be the target playback control, and one or both of the current loop mode and the next loop mode in the multimedia interface are used as the control indication information of any of the playback controls; Otherwise, when any of the playback controls is determined to be a name control, the any of the playback controls is determined to be the target playback control, and the data name of the media data indicated by the name control is used as the control indication information of the any of the playback controls; The acquisition unit is further configured to acquire, from at least two indication messages of the target playback control, the function indication message and the control indication message of the target playback control; the function indication message is used to indicate the role of the target playback control in playing control on the multimedia interface, and the control indication message of the target playback control is used to indicate the method adopted by the target playback control when playing control on the multimedia interface; The encoding unit is configured to perform vibration encoding processing on the target playback control based on the function indication information to obtain the function encoding information of the target playback control, and to perform vibration encoding processing on the target playback control according to the control indication information to obtain the control encoding information of the target playback control; The processing unit is configured to use the function encoding information and the control encoding information as vibration encoding information of the target playback control; wherein the vibration encoding information is used to output corresponding vibrations to indicate that the target playback control has been selected through the output vibrations.

12. A computer device, characterized in that, The device includes a processor and a memory interconnected thereto, wherein the memory is used to store a computer program, the computer program including program instructions, and the processor is configured to invoke the program instructions to perform the method as described in any one of claims 1 to 10.

13. A computer storage medium, characterized in that, The computer storage medium stores a computer program, the computer program including program instructions, which, when executed by a processor, cause the processor to perform the method as described in any one of claims 1 to 10.

14. A computer program product, characterized in that, The computer program product includes a computer program stored in a computer storage medium, which, when loaded and executed by a processor in a computer device, causes the computer device to perform the method as described in any one of claims 1 to 10.

Images