Tactile blending for concurrent tactile events

Abstract

In some aspects, an electronic device can receive multiple tactile signals associated with multiple tactile events, wherein the multiple tactile events overlap in the time domain. The electronic device can generate a hybrid tactile signal that combines the multiple tactile signals in the mechanical acceleration domain, wherein the hybrid tactile signal stores timing or synchronization information associated with the multiple tactile signals. The electronic device can generate an output stream to be provided to a tactile actuator, wherein the output stream includes a pulse code modulation (PCM) voltage signal based on the hybrid tactile signal combining the multiple tactile signals. Numerous other aspects are described.

Description

[0001] Cross-references to related applications

[0002] This patent application claims priority to U.S. Patent Application No. 18 / 511,415, filed November 16, 2023, entitled “HAPTICS MIXING FORCONCURRENT HAPTIC EVENTS”, assigned to the assignee of this application. The disclosure of the earlier application is considered part of this patent application and is incorporated herein by reference. Technical Field

[0003] All aspects of this disclosure relate to haptic feedback in general, and, for example, to haptic blending for concurrent haptic events. Background Technology

[0004] Haptic technology (sometimes referred to as kinematic technology or three-dimensional (3D) touch technology) creates tactile experiences (e.g., haptic experiences) by applying force, vibration, motion, or other feedback (e.g., physical or mechanical outputs) that produces a tactile sensation perceptible to the user. For example, haptic technology can be used to simulate the feeling of touching an object in a virtual environment (e.g., in extended reality applications), to provide haptic feedback or haptic indication in control systems, and / or to provide physical or haptic elements for music, among many other use cases. In some cases, haptic technology can be combined with haptic sensors capable of measuring the force applied by the user to the interface, and / or with haptic actuators capable of generating the force perceived by the user on the interface. Summary of the Invention

[0005] Some aspects described herein relate to a method for haptic blending via an electronic device. The method may include receiving multiple haptic signals associated with multiple haptic events, wherein the multiple haptic events overlap in the time domain. The method may include generating a hybrid haptic signal that combines the multiple haptic signals in a mechanical acceleration domain, wherein the hybrid haptic signal stores timing or synchronization information associated with the multiple haptic signals. The method may include generating an output stream to be provided to a haptic actuator, wherein the output stream includes a pulse code modulation (PCM) voltage signal based on the hybrid haptic signal combining the multiple haptic signals.

[0006] Some aspects described herein relate to an electronic device for wireless communication. The electronic device may include one or more memories and one or more processors coupled to the one or more memories. The one or more processors may be configured to receive a plurality of tactile signals associated with a plurality of tactile events, wherein the plurality of tactile events overlap in the time domain. The one or more processors may be configured to generate a hybrid tactile signal that combines the plurality of tactile signals in a mechanical acceleration domain, wherein the hybrid tactile signal stores timing or synchronization information associated with the plurality of tactile signals. The one or more processors may be configured to generate an output stream to be provided to a tactile actuator, wherein the output stream includes a PCM voltage signal based on the hybrid tactile signal combining the plurality of tactile signals.

[0007] Some aspects described herein relate to a non-transitory computer-readable medium storing an instruction set. When executed by one or more processors of an electronic device, the instruction set enables the electronic device to receive multiple tactile signals associated with multiple tactile events, wherein the multiple tactile events overlap in the time domain. When executed by one or more processors of the electronic device, the instruction set enables the electronic device to generate a mixed tactile signal that combines the multiple tactile signals in a mechanical acceleration domain, wherein the mixed tactile signal stores timing or synchronization information associated with the multiple tactile signals. When executed by one or more processors of the electronic device, the instruction set enables one of the electronic devices to generate an output stream to be provided to a tactile actuator, wherein the output stream includes a PCM voltage signal based on the mixed tactile signal combining the multiple tactile signals.

[0008] Some aspects described herein relate to an apparatus for wireless communication. The apparatus may include components for receiving multiple tactile signals associated with multiple tactile events, wherein the multiple tactile events overlap in the time domain. The apparatus may include components for generating a mixed tactile signal that combines the multiple tactile signals in a mechanical acceleration domain, wherein the mixed tactile signal stores timing or synchronization information associated with the multiple tactile signals. The apparatus may include components for generating an output stream to be provided to a tactile actuator, wherein the output stream includes a PCM voltage signal based on the mixed tactile signal combining the multiple tactile signals.

[0009] The entirety of the categories includes, substantially with reference to the accompanying drawings and specifications, as well as the methods, apparatus, systems, computer program products, non-transitory computer-readable media, electronic devices, tactile devices, user equipment, user gear, wireless communication devices, and / or processing systems as described in the drawings and illustrated in the specifications.

[0010] The features and technical advantages of the examples according to this disclosure have been summarized rather broadly above in order to better understand the detailed description below. Additional features and advantages will be described below. The disclosed concepts and specific examples can be readily used as the basis for modifying or designing other structures for achieving the same purpose as this disclosure. Such equivalent constructions do not depart from the scope of the appended claims. The characteristics of the concepts disclosed herein (both their organization and operation) and their associated advantages will be better understood from the following description when considered in conjunction with the accompanying drawings. Each figure in the drawings is provided for illustrative and descriptive purposes and not as a definition of limitation of the claims. Attached Figure Description

[0011] To gain a full understanding of the foregoing features of this disclosure, a more specific description of the invention, briefly outlined above, can be obtained by referring to various aspects, some of which are illustrated in the accompanying drawings. However, it should be noted that the drawings illustrate only certain typical aspects of this disclosure and are therefore not to be considered as limiting its scope, as other equally valid aspects are permissible in this description. The same reference numerals in different drawings may identify the same or similar elements.

[0012] Figure 1 This is a diagram illustrating an example environment according to the present disclosure, including one or more devices capable of supporting haptic blending for concurrent haptic events.

[0013] Figure 2 This is an example of what is done according to this disclosure. Figure 1 A diagram showing example components of one or more devices.

[0014] Figures 3 to 5 This is a diagram illustrating an example of tactile blending associated with concurrent tactile events according to this disclosure.

[0015] Figure 6 This is a flowchart of an example process associated with tactile blending for concurrent tactile events, according to this disclosure. Detailed Implementation

[0016] Various aspects of this disclosure are described more fully below with reference to the accompanying drawings. However, this disclosure may be embodied in many different forms and should not be construed as limited to any particular structure or function presented throughout this disclosure. Rather, these aspects are provided so that this disclosure will be comprehensive and complete, and will fully convey the scope of protection of this disclosure to those skilled in the art. Those skilled in the art will appreciate that the scope of this disclosure is intended to cover any aspect of this disclosure disclosed herein, whether implemented independently or in combination with any other aspect of this disclosure. For example, any number of aspects set forth herein may be used to implement an apparatus or practice. Furthermore, the scope of this disclosure is intended to cover such apparatuses or methods implemented using structures, functions, or structures and functions other than or different from the aspects of the disclosure set forth herein. It should be understood that any aspect of this disclosure disclosed herein may be embodied by one or more elements of these claims.

[0017] Haptic feedback is a haptic feedback technology that reconstructs the sense of touch by applying user-perceptible forces, vibrations, or motions to electronic devices. Haptic feedback is typically designed to enhance the user experience by providing the physical sensations of interacting with real-world objects. It is often integrated into electronic devices such as smartphones, game controllers, wearables, and virtual reality systems, and is generally designed to provide users with a more immersive and engaging experience. For example, by using actuators, sensors, and algorithms, haptic feedback technology can generate a variety of tactile sensations, including vibrations, impulses, textures, and forces, to convey information or simulate physical interactions. By integrating haptic feedback into user interfaces, devices can provide subtle cues, notifications, or responses, thereby enhancing the overall usability and interactivity of the technology. As haptic technology continues to advance, there is a growing focus on creating more nuanced and realistic haptic experiences for applications in fields such as gaming, virtual reality, healthcare, and / or automotive interfaces.

[0018] However, one problem in haptic feedback systems is that haptic signals are typically defined by unique parameter constraints and / or by LRA-specific voltage waveforms applied directly to a hardware-based linear resonant driver (LRA). For example, existing haptic feedback often uses voltage waveforms generated or designed by the LRA vendor, pre-tuned to the underlying hardware, making it impossible to port from one device to another, or from one LRA or haptic device to another. Therefore, haptic feedback systems often lack standardized and / or consistent techniques to handle concurrent haptic events that fully or partially overlap in the time domain (e.g., a first haptic event lasting a specific duration occurs, and a second haptic event is triggered at some point during the first haptic event). In cases where the first and second haptic events overlap in the time domain, a common approach in haptic feedback systems is to terminate the playback of the first waveform corresponding to the first haptic event and begin the playback of the second waveform corresponding to the second haptic event. Alternatively, another approach used in haptic feedback systems is to simply ignore or discard the second haptic event. In any case, the user experience does not match the user's expectations for haptic feedback, there may be discontinuities and / or degradation in the haptic waveform, and / or the user experience may be inconsistent across different devices and / or platforms that support haptic feedback.

[0019] Therefore, some aspects described herein relate to techniques for enabling haptic blending for concurrent haptic events. For example, as described herein, an electronic device supporting haptic feedback may include a haptic mixer component capable of receiving and combining multiple concurrent and asynchronous haptic events and / or signals and / or audio-derived haptic signals. For example, in some aspects, multiple concurrent and asynchronous haptic events may include one or more discrete haptic events that may correspond to predefined haptic waveforms (e.g., explosions, gunshots, jumps, or object acquisition in gaming applications) from one or more sources, wherein the discrete haptic events may be associated with descriptive waveform designer (WFD) parameters (such as scene position and / or weights) derived from one or more haptic event data in a piecewise form based on piecewise linear (PWL) or pulse code modulation (PCM) acceleration. Additionally or alternatively, blended or otherwise combined haptic events may include one or more audio-to-haptic events derived from an audio stream. In some aspects, the haptic mixer component can generate an output signal associated with a mechanical acceleration format independent of the LRA, which can benefit upstream intelligent mixing. For example, haptic events can be processed regardless of other concurrent haptic events or audio-to-haptic events, and the mixed haptic output can support a format of continuous, low-latency haptics provided to the LRA presenting the mixed haptic output. For example, the mixed haptic output format can be independent of the LRA device and therefore portable across haptic platforms. Furthermore, intelligent haptic mixing can support multiple output streams (e.g., one output stream per destination LRA) in a haptic platform that includes multiple LRAs. Additionally, as described herein, the mixed haptic output can utilize configuration data programmable by the original equipment manufacturer (OEM), such as the number and installation location of haptic devices required to route multiple mixed outputs to different LRAs in the haptic platform. In this way, some aspects described herein provide techniques for combining vibrations of concurrent haptic events, enabling consistent behavior across platforms in the presence of concurrent haptic events, and / or providing a natural and expected user experience for concurrent haptic events.

[0020] Figure 1 This is a diagram illustrating an example environment according to this disclosure, including one or more devices capable of supporting haptic blending for concurrent haptic events. Figure 1 As shown, environment 100 may include electronic device 110, source device 120, and network 130. The devices in environment 100 may be interconnected via wired connection, wireless connection, or a combination of wired and wireless connection.

[0021] Electronic device 110 includes one or more devices capable of receiving, generating, storing, processing, and / or providing information related to tactile mixing for concurrent tactile events. For example, in some aspects, electronic device 110 may include tactile device 112 capable of generating playback waveforms for generating tactile feedback, as described herein. For example, tactile device 112 may include one or more devices capable of receiving playback waveforms and converting them into tactile feedback, tactile response, or another type of tactile output. For example, tactile device 112 may include a linear resonant actuator, an eccentric rotary mass motor, a piezoelectric actuator, and / or another type of tactile device capable of receiving playback waveforms as input and generating vibrational outputs or patterns, force feedback, ultrasonic pressure, or another type of tactile feedback or output based at least in part on the playback waveforms. In some respects, electronic device 110 may include communication devices and / or computing devices, such as user equipment (e.g., smartphones or wireless phones), laptop computers, tablet computers, handheld computers, wearable communication devices (e.g., smartwatches, smart glasses, etc.), gaming devices (e.g., video game consoles, handheld gaming devices, wearable gaming devices, video game controllers, etc.), virtual reality devices, augmented reality devices, extended reality devices, Internet of Things (IoT) devices, or similar types of devices.

[0022] Source device 120 includes one or more devices capable of receiving, generating, storing, processing, and / or providing information related to haptic mixing for concurrent haptic events. For example, source device 120 may include any suitable device or combination of devices capable of generating one or more haptic events, such as audio-synchronized (e.g., music-based) haptics, gaming haptics, telephone or device alarms, ringtones, and / or other suitable haptic events. In some aspects, source device 120 may be separable from electronic device 110, or source device 120 may include electronic device. For example, in some aspects, source device 120 may be user equipment, laptop computer, tablet computer, handheld computer, wearable communication device, gaming device, virtual reality device, augmented reality device, extended reality device, IoT device, television, soundbar, stereo receiver, home theater system, set-top box, streaming device, casting rod, and / or another suitable device capable of generating one or more haptic events.

[0023] like Figure 1As further shown, the electronic device 110 may include a haptic mixer component 114 that can receive, generate, store, process, and / or provide information related to haptic mixing for concurrent haptic events. For example, in some aspects, the haptic mixer component 114 may (e.g., from a source device 120) receive multiple haptic signals associated with multiple haptic events, wherein the multiple haptic events overlap in the time domain; may generate a mixed haptic signal that combines the multiple haptic signals in the mechanical acceleration domain, wherein the mixed haptic signal stores timing or synchronization information associated with the multiple haptic signals; and / or may generate an output stream to be provided to a haptic actuator (e.g., haptic device 112), wherein the output stream includes a PCM voltage signal based on the mixed haptic signal combining the multiple haptic signals.

[0024] Network 130 includes one or more wired and / or wireless networks. For example, network 130 may include cellular networks (e.g., Long Term Evolution (LTE) networks, Code Division Multiple Access (CDMA) networks, 3G networks, 4G networks, 5G networks, another type of next-generation network, etc.), Public Land Mobile Network (PLMN), Local Area Network (LAN), Wide Area Network (WAN), Metropolitan Area Network (MAN), Telephone Network (e.g., Public Switched Telephone Network (PSTN)), Private Network, Self-organizing Network, Intranet, Internet, Fiber-based Network, Cloud Computing Network, etc., and / or combinations of these or other types of networks.

[0025] Figure 1 The number and arrangement of devices and networks shown are provided as an example. In practice, there may be different arrangements. Figure 1 The devices and / or networks shown are compared to additional devices and / or networks, fewer devices and / or networks, different devices and / or networks, or devices and / or networks arranged in a different manner. Furthermore, Figure 1 The two or more devices shown can be implemented within a single device, or Figure 1 The single device shown can be implemented as multiple distributed devices. Additionally or alternatively, the set of devices in environment 100 (e.g., one or more devices) can perform one or more functions described as being performed by another set of devices in example environment 100.

[0026] Figure 2 This is a diagram illustrating example components of device 200 according to the present disclosure. Device 200 may correspond to electronic device 110 and / or source device 120. In some aspects, electronic device 110 and / or source device 120 may include one or more devices 200 and / or one or more components of device 200. Figure 2As shown, device 200 may include bus 205, processor 210, memory 215, storage component 220, input component 225, output component 230, communication component 235, sensor 240, haptic actuator 245 and / or haptic mixer component 250.

[0027] Bus 205 may include one or more components that enable wired and / or wireless communication between components of device 200. Bus 205 may connect components such as via operative coupling, communicative coupling, electronic coupling, and / or electrical coupling. Figure 2 Two or more components are coupled together. For example, bus 205 may include electrical connections (e.g., wires, traces, and / or leads) and / or wireless buses. Processor 210 may include a central processing unit, graphics processing unit, microprocessor, controller, microcontroller, digital signal processor, field-programmable gate array, application-specific integrated circuit, and / or another type of processing component. Processor 210 may be implemented in hardware, firmware, or a combination of hardware and software. In some aspects, processor 210 may include one or more processors capable of being programmed to perform one or more operations or processes described elsewhere herein.

[0028] Memory 215 may include volatile memory and / or non-volatile memory. For example, memory 215 may include random access memory (RAM), read-only memory (ROM), hard disk drive, and / or another type of memory (e.g., flash memory, magnetic memory, and / or optical memory). Memory 215 may include internal memory (e.g., RAM, ROM, or hard disk drive) and / or removable memory (e.g., removable via a universal serial bus connection). Memory 215 may be a non-transitory computer-readable medium. Memory 215 may store information related to the operation of device 200, one or more instructions, and / or software (e.g., one or more software applications). In some aspects, memory 215 may include one or more memories, such as those coupled (e.g., communicatively coupled) to one or more processors (e.g., processor 210), via bus 205. The communicative coupling between processor 210 and memory 215 enables processor 210 to read and / or process information stored in memory 215 and / or store information in memory 215.

[0029] Storage component 220 may store information and / or software related to the operation and use of device 200. For example, storage component 220 may include hard disk (e.g., magnetic disk, optical disk, magneto-optical disk and / or solid-state disk), compact disc (CD), digital versatile optical disc (DVD), floppy disk, cassette, magnetic tape, and / or another type of non-transitory computer-readable medium, together with corresponding drives.

[0030] Input component 225 enables device 200 to receive input, such as user input and / or sensed input. For example, input component 225 may include a touchscreen, keyboard, keypad, mouse, button, microphone, switch, sensor, GPS sensor, GNSS sensor, accelerometer, gyroscope, and / or actuator. Output component 230 enables device 200 to provide output, such as via a display, speaker, and / or LED. Communication component 235 enables device 200 to communicate with other devices via wired and / or wireless connections. For example, communication component 235 may include a receiver, transmitter, transceiver, modem, network interface card, and / or antenna.

[0031] Sensor 240 includes one or more wired or wireless devices capable of receiving, generating, storing, transmitting, processing, detecting, and / or providing information associated with the state of device 200 and / or the environment surrounding device 200, as described elsewhere herein. For example, sensor 240 may include a touchscreen controller, force sensor, motion sensor, accelerometer, gyroscope, proximity sensor, light sensor, noise sensor, pressure sensor, ultrasonic sensor, positioning sensor, capacitive sensor, timing device, infrared sensor, active sensor (e.g., requiring an external power signal), passive sensor (e.g., not requiring an external power signal), biological or biometric sensor, smoke sensor, gas sensor, chemical sensor, alcohol sensor, temperature sensor, humidity sensor, radioactive sensor, magnetic sensor, electromagnetic sensor, analog sensor, and / or digital sensor, among other examples. Sensor 240 may sense or detect conditions or information associated with the state of device 200 and / or the environment surrounding device 200, and transmit indications of the detected conditions or information to other components and / or devices of device 200 using a wired or wireless communication interface.

[0032] The haptic actuator 245 includes one or more devices, as described elsewhere herein, capable of receiving, generating, storing, transmitting, processing, detecting, and / or providing information associated with haptic blending for concurrent haptic events. For example, the haptic actuator 245 may include a linear resonant actuator (LRA), an eccentric rotating mass (ERM) vibration motor, a piezoelectric actuator, an ultrasonic or electrostatic triboelectric modulated surface actuator, and / or other suitable devices or combinations thereof configured to generate vibrational waveforms or other feedback with different mechanical haptic modes.

[0033] The haptic mixer assembly 250 includes one or more devices that can receive, generate, store, transmit, process, detect, and / or provide information associated with haptic mixing for concurrent haptic events, as described elsewhere herein. In some aspects, the haptic mixer assembly 250 may include a haptic actuator driver or other suitable devices capable of driving or otherwise controlling the haptic actuator 245. For example, in some aspects, the haptic mixer assembly 250 may receive multiple haptic signals associated with multiple haptic events, wherein the multiple haptic events overlap in the time domain; generate a mixed haptic signal that combines the multiple haptic signals in the mechanical acceleration domain, wherein the mixed haptic signal stores timing or synchronization information associated with the multiple haptic signals; and / or generate an output stream to be provided to the haptic actuator 245, wherein the output stream includes a PCM voltage signal based on the mixed haptic signal combining the multiple haptic signals.

[0034] Device 200 may perform one or more operations or procedures described herein. For example, a non-transitory computer-readable medium (e.g., memory 215) may store a set of instructions (e.g., one or more instructions or code) for execution by processor 210. Processor 210 may execute the set of instructions to perform one or more operations or procedures described herein. In some aspects, execution of the set of instructions by one or more processors 210 causes one or more processors 210 and / or device 200 to perform one or more operations or procedures described herein. In some aspects, hardwired circuitry may be used in place of or in combination with instructions to perform one or more operations or procedures described herein. Additionally or alternatively, processor 210 may be configured to perform one or more operations or procedures described herein. Thus, the aspects described herein are not limited to any particular combination of hardware circuitry and software.

[0035] In some aspects, device 200 may include components for receiving multiple tactile signals associated with multiple tactile events, wherein the multiple tactile events overlap in the time domain; components for generating a mixed tactile signal that combines the multiple tactile signals in the mechanical acceleration domain, wherein the mixed tactile signal stores timing or synchronization information associated with the multiple tactile signals; and / or components for generating an output stream to be provided to a tactile actuator, wherein the output stream includes a PCM voltage signal based on the mixed tactile signal combining the multiple tactile signals. In some aspects, components for causing device 200 to perform the processes and / or operations described herein may include combinations of... Figure 2The described device 200 includes one or more components such as bus 205, processor 210, memory 215, storage component 220, input component 225, output component 230, communication component 235, sensor 240, haptic actuator 245, haptic mixer component 250, and / or any suitable combination thereof.

[0036] Figure 2 The number and arrangement of components shown are provided as an example. Figure 2 Compared to the components shown, device 200 may include additional components, fewer components, different components, or components arranged in a different manner. Additionally or alternatively, the set of components of device 200 (e.g., one or more components) may perform one or more functions described as being performed by another set of components of device 200.

[0037] Figure 3 This is an illustration of example 300 associated with tactile blending for concurrent tactile events according to this disclosure. Figure 3 As shown, Example 300 includes a haptic mixer component 310 that can generate one or more mixed haptic signals H based on a platform-independent haptic waveform format (referred to herein as the PCM_G format). m In this way, by representing haptic events in a platform-independent format, the haptic mixer component 310 can use one or more haptic mixing algorithms to mix two or more concurrent haptic signals (e.g., fully or partially overlapping in the temporal domain) to provide a consistent mixed haptic user experience across different haptic platforms.

[0038] In some aspects, as described herein, the haptic mixer component 310 may receive multiple haptic signals associated with multiple haptic events overlapping in the temporal domain. For example, in a haptic gaming environment, a first haptic event may correspond to a thunderstorm occurring in the background, which may be associated with a first haptic signal comprising a number of low-frequency vibrations, each having a long duration that may last for several seconds. Furthermore, a second haptic event may correspond to an action occurring in the foreground, such as a gunfight where each shot includes a high-pulse burst that occurs whenever the user performs an interaction to pull the trigger. Therefore, in some aspects, the haptic mixer component 310 may generally receive multiple haptic signals (including at least a first haptic signal and a second haptic signal) that fully or partially overlap in the temporal domain, and the haptic mixer component 310 may be configured to intelligently combine or mix the multiple haptic signals in a manner that reflects the user's desired experience as feedback associated with the various haptic events.

[0039] Therefore, as Figure 3As shown and further described in detail herein, the haptic mixer component 310 can receive multiple haptic signals associated with multiple haptic events that overlap in the time domain, wherein the multiple haptic signals may include any suitable concurrent and asynchronous haptic signals derived from predefined or parameterized haptic events and / or audio events. For example, as Figure 3 As shown, the haptic mixer component 310 can be coupled to an event-to-haptic WFD component 320, which can receive one or more discrete haptic events 325, which can correspond to one or more predefined haptic waveforms originating from one or more sources. For example, in a gaming application, the discrete haptic event 325 can correspond to any suitable game event, such as an explosion, gunshot, jump, item acquisition, bomb explosion, car engine, special effects, lightning events, etc. In another context, the discrete haptic event 325 can correspond to one or more alarm haptics, such as a low battery event, a received short message service (SMS) event, a notification, a mobile device ringtone, etc. In some aspects, the discrete haptic events 325 received by the event-to-haptic WFD component 320 can be associated with one or more descriptive WFD parameters, such as scene position and / or weights, and the discrete haptic events 325 can be formatted as fragments based on PWL acceleration or fragments based on PCM acceleration. Additionally or alternatively, such as Figure 3 As shown, the haptic mixer component 310 can be coupled to the audio-to-haptic WFD component 330, which can receive one or more audio-to-haptic events 335 derived from one or more audio streams (e.g., predefined audio streams or runtime audio streams, such as drum sounds during a sustained bass event).

[0040] In some aspects, the haptic mixer component 310 may then generate a hybrid haptic signal that combines multiple haptic signals in a mechanical acceleration domain in a manner that preserves timing or synchronization information associated with the multiple haptic signals. For example, as described herein, the haptic mixer component 310 may receive a first haptic event that may correspond to a discrete haptic event 325 and / or an audio-to-haptic event 335, and may receive a second haptic event that may correspond to a discrete haptic event 325 and / or an audio-to-haptic event 335 that fully or partially overlaps with the first haptic event. In some aspects, the haptic mixer component 310 may then generate a hybrid haptic signal that combines multiple haptic signals in a mechanical acceleration domain based on one or more parameters associated with the multiple haptic events and configuration data associated with a haptic platform (e.g., one or more haptic devices) coupled to the haptic mixer component 310. For example, in some aspects, configuration data may include platform details such as the number of haptic devices supported by the haptic platform, the OEM programmable installation locations of the haptic devices (e.g., routing multiple hybrid haptic outputs to different LRAs or other haptic devices), the configuration capabilities of the installed LRAs or other haptic devices, and / or mechanical installation and / or orientation information associated with the installed LRAs or other haptic devices.

[0041] In some aspects, such as Figure 3 As shown, the haptic mixer assembly 310 can generate an output stream that includes one or more mixed haptic signals 350 (H m This is to be provided to one or more haptic actuators, such as one or more LRAs. For example, as described herein, the haptic mixer component 310 may use one or more haptic algorithms 360 to generate a mixed haptic signal 350 in a mechanical acceleration format independent of the LRA, wherein each mixed haptic signal 350 may include a PCM voltage signal 370, which is based on a mixed haptic signal combining multiple (source) haptic signals being provided to the corresponding LRA. For example, in some aspects, the mixed haptic signal 350 may be generated in an upstream mixing manner (e.g., by one or more haptic algorithms 360) because each haptic event is processed independently of other concurrent haptic events 325 and / or audio-to-haptic events 335. In particular, the mixed haptic signal 350 (H mThe haptic mixer component 310 generates a format independent of LRA type or other haptic device type, and is therefore portable across different haptic platforms. Furthermore, as shown, in cases where the haptic platform includes multiple LRAs or haptic devices, the haptic mixer component 310 can support multiple output streams (e.g., one output stream per destination LRA or destination haptic device). For example, the haptic mixer component 310 can generate a first output stream including a first mixed haptic signal 350-1 and a second output stream including a second mixed haptic signal 350-2, the first mixed haptic signal being processed by a first haptic algorithm 360-1 to generate a first PCM signal 370-1 formatted according to a codec associated with a first LRA, and the second mixed haptic signal being processed by a second haptic algorithm 360-2 to generate a second PCM signal 370-2 formatted according to a codec associated with a second LRA.

[0042] As indicated above, Figure 3 This is provided as an example. Other examples are available with reference to [the relevant information]. Figure 3 The examples described are different. Figure 3 The number and arrangement of devices shown are provided as an example. In reality, similar arrangements are possible. Figure 3 The equipment shown is compared to additional equipment, fewer equipment, different equipment, or equipment arranged in a different manner. Furthermore, Figure 3 The two or more devices shown can be implemented within a single device, or Figure 3 The single device shown can be implemented as multiple distributed devices. Additionally or alternatively, Figure 3 The set of devices shown (e.g., one or more devices) can be executed as described by Figure 3 The other set of devices shown performs one or more functions.

[0043] Figure 4 This is an illustration of example 400 associated with tactile blending for concurrent tactile events according to this disclosure. Figure 4As shown, Example 400 includes a haptic mixer assembly 410, which includes a mixing component 420 for mixing multiple PCM_G inputs corresponding to multiple haptic signals, and a conversion component 430 for converting WFD haptic signals into PCM_G inputs. For example, as described herein, PCM_G inputs may typically correspond to platform-agnostic signals in the mechanical acceleration domain that can store timing and synchronization information for multiple haptic events. Thus, in some aspects, the mixing component 420 may receive one or more PCM_G inputs 422, and the conversion component 430 may receive one or more WFD haptic inputs 432, which can be converted into PCM_G inputs 434. These PCM_G inputs are provided to the mixing component 420 to generate a mixed haptic signal that combines the PCM_G inputs 422, 434 in the mechanical acceleration domain in a manner that preserves timing or synchronization information.

[0044] For example, in some aspects, each PCM_G input 422, 434 may be associated with a channel information data structure that is compatible with an application programming interface (API) supported by the mixing component 420. For example, the channel information data structure associated with each of the PCM_G inputs 422, 434 may include an event type field indicating whether the PCM_G input 422, 434 is associated with a parameterized haptic event or an audio-to-haptic event, a weighting value associated with the haptic channel, the selected haptic mixing algorithm, a set of coordinates (e.g., Cartesian coordinates of the haptic event on the x, y, and z axes, which may be useful in scaling and / or directional haptics when the haptic platform includes multiple LRAs or haptic actuators), an optional PWL field indicating the PWL representation of the haptic event (e.g., based on time and amplitude pairs), and / or audio stream information (e.g., sample rate and / or beats per second).

[0045] Therefore, as described herein, the mixing component 420 can receive multiple PCM_G inputs 422, 434, and can use suitable mixing algorithms (e.g., parameters selected as PCM_G inputs 422, 434) to provide flexibility in the haptic mixing configuration for generating the mixed PCM_G output 440. For example, the available mixing algorithms can generally be time-independent and can enable multiple waveforms corresponding to different haptic signals to be combined according to any suitable time relationship. For example, in some aspects, the mixing component 420 can be configured to use an overlap algorithm to generate the mixed PCM_G output 440, wherein each PCM_G input 422, 434 can correspond to each time T. n Has acceleration value A n and weight W nThe waveform. Therefore, when using the overlap algorithm, the mixing component 420 can generate a mixed PCM_G output 440, such that for waveforms with weights W1, W2, ... W... n Concurrent accelerations A1, A2, ... A n Any given time T associated with n The output of the mixed PCM_G is 440. , … The maximum value of ). Additionally or alternatively, the mixing component 420 may use a weighted sum algorithm to generate a mixed PCM_G output 440, such that for a given PCM_G with weights W1, W2, ... W n Concurrent accelerations A1, A2, ... A n Any given time T associated with n The hybrid PCM_G output is 440. Additionally or alternatively, the hybrid component 420 may use a weighted average algorithm to generate the hybrid PCM_G output 440, such that for each PCM_G with weights W1, W2, ... W... n Concurrent accelerations A1, A2, ... A n Any given time T associated with n The output of the mixed PCM_G is 440. , … ) / (W1+W2+… W n ).

[0046] As indicated above, Figure 4 This is provided as an example. Other examples are available with reference to [the relevant information]. Figure 4 The examples described are different. Figure 4 The number and arrangement of devices shown are provided as an example. In reality, similar arrangements are possible. Figure 4 The equipment shown is compared to additional equipment, fewer equipment, different equipment, or equipment arranged in a different manner. Furthermore, Figure 4 The two or more devices shown can be implemented within a single device, or Figure 4 The single device shown can be implemented as multiple distributed devices. Additionally or alternatively, Figure 4 The set of devices shown (e.g., one or more devices) can be executed as described by Figure 4 The other set of devices shown performs one or more functions.

[0047] Figure 5 This is an illustration of example 500 associated with tactile blending for concurrent tactile events according to this disclosure. Figure 5As shown, Example 500 includes a first tactile signal 510, which can be combined or mixed with a second tactile signal 520 to generate a mixed tactile signal 530, which stores timing or synchronization information associated with the first tactile signal 510 and the second tactile signal 520. For example, as described herein, the mixed tactile signal 530 can use the references above. Figure 3 and / or Figure 4 One or more techniques are described in further detail to generate the mixed haptic signal 530. For example, the mixed haptic signal 530 may be generated using an overlap algorithm, a weighted sum algorithm, and / or a weighted average algorithm, which generates an output based on concurrent accelerations and weights associated with the mixed haptic signal at any given time.

[0048] For example, refer to Figure 5 The first tactile signal 510 may correspond to a repetitive event, such as a repetitive gunshot in a gaming application, and the second tactile signal 520 may correspond to a longer periodic event, such as a lightning strike. As further shown, a hybrid tactile signal 530 combines the first tactile signal 510 and the second tactile signal 520 to create a hybrid tactile signal 530 with a precise and intuitive tactile sensation. For example, as shown, during one or more active or low-amplitude time periods of the first tactile signal 510, the waveform of the hybrid tactile signal 530 includes an amplitude based on the waveform of the second tactile signal 520. Furthermore, during time periods associated with high amplitude, the first tactile signal 510 is shown as covering the low-amplitude portion of the second tactile signal 520. Therefore, as described herein, the hybrid tactile signal 530 may use an overlap algorithm, a weighted sum algorithm, and / or a weighted average algorithm to combine the first tactile signal 510 and the second tactile signal 520 to create the hybrid tactile signal 530.

[0049] As indicated above, Figure 5 This is provided as an example. Other examples are available with reference to [the relevant information]. Figure 5 The examples described are different. Figure 5 The number and arrangement of devices shown are provided as an example. In reality, similar arrangements are possible. Figure 5 The equipment shown is compared to additional equipment, fewer equipment, different equipment, or equipment arranged in a different manner. Furthermore, Figure 5 The two or more devices shown can be implemented within a single device, or Figure 5 The single device shown can be implemented as multiple distributed devices. Additionally or alternatively, Figure 5 The set of devices shown (e.g., one or more devices) can be executed as described by Figure 5 The other set of devices shown performs one or more functions.

[0050] Figure 6This is a flowchart of an example process 600 associated with haptic blending for concurrent haptic events, according to this disclosure. In some aspects, Figure 6 One or more process frames are executed by electronic devices (e.g., electronic device 110, device 200, haptic mixer assembly 310, haptic mixer assembly 410, etc.). In some aspects, Figure 6 One or more process frames are performed by another device or group of devices that are separate from or include the electronic device, such as source device 120 or another suitable device. Additionally or alternatively, Figure 6 One or more process blocks may be executed by one or more components of device 200, such as processor 210, memory 215, storage component 220, input component 225, output component 230, communication component 235, sensor 240, haptic actuator 245, and / or haptic mixer component 250.

[0051] like Figure 6 As shown, process 600 may include receiving multiple tactile signals associated with multiple tactile events, wherein the multiple tactile events overlap in the time domain (box 610). For example, an electronic device may receive multiple tactile signals associated with multiple tactile events, wherein the multiple tactile events overlap in the time domain, as described above.

[0052] like Figure 6 As further shown, process 600 may include generating a hybrid tactile signal that combines multiple tactile signals in a mechanical acceleration domain, wherein the hybrid tactile signal stores timing or synchronization information associated with the multiple tactile signals (box 620). For example, an electronic device may generate a hybrid tactile signal that combines the multiple tactile signals in a mechanical acceleration domain, wherein the hybrid tactile signal stores timing or synchronization information associated with the multiple tactile signals, as described above.

[0053] like Figure 6 As further shown, process 600 may include generating an output stream to be provided to a haptic actuator, wherein the output stream includes a PCM voltage signal based on a hybrid haptic signal combining multiple haptic signals (block 630). For example, an electronic device may generate an output stream to be provided to a haptic actuator, wherein the output stream includes a PCM voltage signal based on the hybrid haptic signal combining the multiple haptic signals, as described above.

[0054] Process 600 may include additional aspects, such as any single aspect or any combination of aspects described below and / or in conjunction with one or more other processes described elsewhere herein.

[0055] In the first aspect, one or more of the multiple tactile events are discrete tactile events associated with a tactile waveform that is associated with one or more WFD parameters.

[0056] In the second aspect, either alone or in combination with the first aspect, one or more of the multiple tactile events are audio-to-tactile events associated with the audio stream.

[0057] In a third aspect, alone or in combination with one or more of the first and second aspects, process 600 includes: receiving a second plurality of tactile signals associated with a second plurality of tactile events, the second plurality of tactile events overlapping in the time domain; generating a second hybrid tactile signal that combines the second plurality of tactile signals in a mechanical acceleration domain, wherein the second hybrid tactile signal stores timing or synchronization information associated with the second plurality of tactile signals; and generating a second output stream to be provided to a second tactile actuator, wherein the second output stream includes a second PCM voltage signal based on the second hybrid tactile signal combining the second plurality of tactile signals.

[0058] In the fourth aspect, either alone or in combination with one or more of the first to third aspects, the multiple tactile signals are combined based on configuration data including one or more parameters related to the tactile actuator to generate a hybrid tactile signal in the mechanical acceleration domain.

[0059] In the fifth aspect, either alone or in combination with one or more of the first to fourth aspects, an overlap algorithm is used to generate a hybrid tactile signal such that, for each moment during which the multiple tactile events overlap in the time domain, the hybrid tactile signal includes an amplitude corresponding to the maximum value of the acceleration parameter multiplied by the weighting parameter across the multiple tactile signals.

[0060] In the sixth aspect, either alone or in combination with one or more of the first to fifth aspects, a weighted sum algorithm is used to generate a hybrid tactile signal such that, for each moment during which the multiple tactile events overlap in the time domain, the hybrid tactile signal includes an amplitude corresponding to the sum of acceleration parameters multiplied by weighting parameters across the multiple tactile signals.

[0061] In the seventh aspect, the mixed tactile signal is generated using a weighted average algorithm, either alone or in combination with one or more of the first to sixth aspects, such that for each moment during which the multiple tactile events overlap in the time domain, the mixed tactile signal includes an amplitude corresponding to a first sum of acceleration parameters multiplied by weighting parameters across the multiple tactile signals divided by a second sum of weighting parameters across the multiple tactile signals.

[0062] although Figure 6An example box of process 600 is shown, but in some respects, process 600 includes... Figure 6 The depicted boxes may be fewer, different, or arranged differently compared to additional boxes, boxes, or boxes in different ways. Alternatively, two or more boxes in the process 600 may be executed in parallel.

[0063] The following provides an overview of some aspects of this disclosure:

[0064] Aspect 1: A method for haptic blending by an electronic device, the method comprising: receiving a plurality of haptic signals associated with a plurality of haptic events, wherein the plurality of haptic events overlap in a time domain; generating a blended haptic signal that combines the plurality of haptic signals in a mechanical acceleration domain, wherein the blended haptic signal stores timing or synchronization information associated with the plurality of haptic signals; and generating an output stream to be provided to a haptic actuator, wherein the output stream includes a PCM voltage signal based on the blended haptic signal combining the plurality of haptic signals.

[0065] Aspect 2: According to the method of aspect 1, one or more of the plurality of tactile events are discrete tactile events associated with a tactile waveform associated with one or more WFD parameters.

[0066] Aspect 3: The method according to any one of Aspects 1 to 2, wherein one or more of the plurality of tactile events are audio-to-tactile events associated with an audio stream.

[0067] Aspect 4: The method according to any one of Aspects 1 to 3, the method further comprising: receiving a second plurality of tactile signals associated with a second plurality of tactile events, the second plurality of tactile events overlapping in the time domain; generating a second mixed tactile signal, the second mixed tactile signal combining the second plurality of tactile signals in the mechanical acceleration domain, wherein the second mixed tactile signal stores timing or synchronization information associated with the second plurality of tactile signals; and generating a second output stream, the second output stream to be provided to a second tactile actuator, wherein the second output stream includes a second PCM voltage signal, the second PCM voltage signal being based on the second mixed tactile signal combining the second plurality of tactile signals.

[0068] Aspect 5: The method according to any one of Aspects 1 to 4, wherein the plurality of tactile signals are combined to generate the hybrid tactile signal in the mechanical acceleration domain based on configuration data including one or more parameters associated with the tactile actuator.

[0069] Aspect 6: The method according to any one of Aspects 1 to 5, wherein an overlap algorithm is used to generate the hybrid tactile signal such that for each moment during which the plurality of tactile events overlap in the time domain, the hybrid tactile signal includes an amplitude corresponding to the maximum value of the acceleration parameter multiplied by the weighting parameter across the plurality of tactile signals.

[0070] Aspect 7: The method according to any one of Aspects 1 to 6, wherein a weighted sum algorithm is used to generate the hybrid tactile signal such that for each moment during which the plurality of tactile events overlap in the time domain, the hybrid tactile signal includes an amplitude corresponding to the sum of acceleration parameters multiplied by weighting parameters across the plurality of tactile signals.

[0071] Aspect 8: The method according to any one of Aspects 1 to 7, wherein the mixed tactile signal is generated using a weighted average algorithm, such that for each moment during which the plurality of tactile events overlap in the time domain, the mixed tactile signal includes an amplitude corresponding to a first sum of acceleration parameters multiplied by weighting parameters across the plurality of tactile signals divided by a second sum of weighting parameters based on the plurality of tactile signals.

[0072] Aspect 9: An electronic device for wireless communication, the electronic device comprising: one or more memories; and one or more processors coupled to the one or more memories, the one or more processors being configured to cause the electronic device to: receive a plurality of tactile signals associated with a plurality of tactile events, wherein the plurality of tactile events overlap in the time domain; generate a hybrid tactile signal that combines the plurality of tactile signals in a mechanical acceleration domain, wherein the hybrid tactile signal stores timing or synchronization information associated with the plurality of tactile signals; and generate an output stream to be provided to a tactile actuator, wherein the output stream includes a PCM voltage signal based on the hybrid tactile signal combining the plurality of tactile signals.

[0073] Aspect 10: The electronic device according to Aspect 9, wherein one or more of the plurality of tactile events are discrete tactile events associated with a tactile waveform associated with one or more WFD parameters.

[0074] Aspect 11: An electronic device according to any one of Aspects 9 to 10, wherein one or more of the plurality of tactile events are audio-to-tactile events associated with an audio stream.

[0075] Aspect 12: An electronic device according to any one of Aspects 9 to 11, wherein the one or more processors are further configured to cause the electronic device to: receive a second plurality of tactile signals associated with a second plurality of tactile events, the second plurality of tactile events overlapping in the time domain; generate a second mixed tactile signal, the second mixed tactile signal combining the second plurality of tactile signals in the mechanical acceleration domain, wherein the second mixed tactile signal stores timing or synchronization information associated with the second plurality of tactile signals; and generate a second output stream, the second output stream to be provided to a second tactile actuator, wherein the second output stream includes a second PCM voltage signal, the second PCM voltage signal being based on the second mixed tactile signal combining the second plurality of tactile signals.

[0076] Aspect 13: An electronic device according to any one of Aspects 9 to 12, wherein the plurality of tactile signals are combined to generate the hybrid tactile signal in the mechanical acceleration domain based on configuration data including one or more parameters associated with the tactile actuator.

[0077] Aspect 14: An electronic device according to any one of Aspects 9 to 13, wherein an overlap algorithm is used to generate the hybrid tactile signal such that, for each moment during which the plurality of tactile events overlap in the time domain, the hybrid tactile signal includes an amplitude corresponding to the maximum value of the acceleration parameter multiplied by the weighting parameter across the plurality of tactile signals.

[0078] Aspect 15: An electronic device according to any one of Aspects 9 to 14, wherein a weighted sum algorithm is used to generate the hybrid tactile signal such that, for each moment during which the plurality of tactile events overlap in the time domain, the hybrid tactile signal includes an amplitude corresponding to the sum of acceleration parameters multiplied by weighting parameters across the plurality of tactile signals.

[0079] Aspect 16: An electronic device according to any one of Aspects 9 to 15, wherein the hybrid tactile signal is generated using a weighted average algorithm such that, for each moment during which the plurality of tactile events overlap in the time domain, the hybrid tactile signal includes an amplitude corresponding to a first sum of acceleration parameters multiplied by weighting parameters across the plurality of tactile signals divided by a second sum of the weighting parameters across the plurality of tactile signals.

[0080] Aspect 17: A non-transitory computer-readable medium storing a set of instructions for wireless communication, the set of instructions comprising: one or more instructions that, when executed by one or more processors of an electronic device, cause the electronic device to: receive a plurality of tactile signals associated with a plurality of tactile events, wherein the plurality of tactile events overlap in the time domain; generate a hybrid tactile signal that combines the plurality of tactile signals in a mechanical acceleration domain, wherein the hybrid tactile signal stores timing or synchronization information associated with the plurality of tactile signals; and generate an output stream to be provided to a tactile actuator, wherein the output stream includes a PCM voltage signal based on the hybrid tactile signal combining the plurality of tactile signals.

[0081] Aspect 18: The non-transitory computer-readable medium according to aspect 17, wherein one or more of the plurality of tactile events are discrete tactile events associated with a tactile waveform associated with one or more WFD parameters.

[0082] Aspect 19: A non-transitory computer-readable medium according to any one of aspects 17 to 18, wherein one or more of the plurality of tactile events are audio-to-tactile events associated with an audio stream.

[0083] Aspect 20: A non-transitory computer-readable medium according to any one of aspects 17 to 19, wherein one or more instructions further cause the electronic device to: receive a second plurality of tactile signals associated with a second plurality of tactile events, the second plurality of tactile events overlapping in the time domain; generate a second mixed tactile signal, the second mixed tactile signal combining the second plurality of tactile signals in the mechanical acceleration domain, wherein the second mixed tactile signal stores timing or synchronization information associated with the second plurality of tactile signals; and generate a second output stream, the second output stream to be provided to a second tactile actuator, wherein the second output stream includes a second PCM voltage signal based on the second mixed tactile signal combining the second plurality of tactile signals.

[0084] Aspect 21: A non-transitory computer-readable medium according to any one of aspects 17 to 20, wherein the plurality of tactile signals are combined to generate the hybrid tactile signal in the mechanical acceleration domain based on configuration data including one or more parameters associated with the tactile actuator.

[0085] Aspect 22: A non-transitory computer-readable medium according to any one of aspects 17 to 21, wherein an overlap algorithm is used to generate the hybrid tactile signal such that, for each moment during which the plurality of tactile events overlap in the time domain, the hybrid tactile signal includes an amplitude corresponding to the maximum value of the acceleration parameter multiplied by the weighting parameter across the plurality of tactile signals.

[0086] Aspect 23: A non-transitory computer-readable medium according to any one of aspects 17 to 22, wherein a weighted sum algorithm is used to generate the hybrid tactile signal such that, for each moment during which the plurality of tactile events overlap in the time domain, the hybrid tactile signal includes an amplitude corresponding to the sum of acceleration parameters multiplied by weighting parameters across the plurality of tactile signals.

[0087] Aspect 24: A non-transitory computer-readable medium according to any one of aspects 17 to 23, wherein the hybrid tactile signal is generated using a weighted average algorithm such that, for each moment during which the plurality of tactile events overlap in the time domain, the hybrid tactile signal includes an amplitude corresponding to a first sum of acceleration parameters multiplied by weighting parameters across the plurality of tactile signals divided by a second sum of the weighting parameters across the plurality of tactile signals.

[0088] Aspect 25: An apparatus for wireless communication, the apparatus comprising: means for receiving a plurality of tactile signals associated with a plurality of tactile events, wherein the plurality of tactile events overlap in a time domain; means for generating a mixed tactile signal, the mixed tactile signal combining the plurality of tactile signals in a mechanical acceleration domain, wherein the mixed tactile signal stores timing or synchronization information associated with the plurality of tactile signals; and means for generating an output stream to be provided to a tactile actuator, wherein the output stream includes a PCM voltage signal based on the mixed tactile signal combining the plurality of tactile signals.

[0089] Aspect 26: The apparatus according to aspect 25, wherein one or more of the plurality of tactile events are discrete tactile events associated with a tactile waveform associated with one or more WFD parameters.

[0090] Aspect 27: The apparatus according to any one of aspects 25 to 26, wherein one or more of the plurality of tactile events are audio-to-tactile events associated with an audio stream.

[0091] Aspect 28: The apparatus according to any one of Aspects 25 to 27, the apparatus further comprising: means for receiving a second plurality of tactile signals associated with a second plurality of tactile events, the second plurality of tactile events overlapping in the time domain; means for generating a second mixed tactile signal, the second mixed tactile signal combining the second plurality of tactile signals in the mechanical acceleration domain, wherein the second mixed tactile signal stores timing or synchronization information associated with the second plurality of tactile signals; and means for generating a second output stream, the second output stream to be provided to a second tactile actuator, wherein the second output stream includes a second PCM voltage signal based on the second mixed tactile signal combining the second plurality of tactile signals.

[0092] Aspect 29: The apparatus according to any one of aspects 25 to 28, wherein the plurality of tactile signals are combined to generate the hybrid tactile signal in the mechanical acceleration domain based on configuration data including one or more parameters associated with the tactile actuator.

[0093] Aspect 30: The apparatus according to any one of aspects 25 to 29, wherein the hybrid tactile signal is generated using an overlap algorithm, a weighted sum algorithm, or a weighted average algorithm.

[0094] Aspect 31: A system configured to perform one or more of the operations described in aspects 1 to 30.

[0095] Aspect 32: An apparatus comprising: components for performing one or more of the operations described in aspects 1 to 30.

[0096] Aspect 33: A non-transitory computer-readable medium storing an instruction set comprising one or more instructions that, when executed by a device, cause the device to perform one or more of the operations described in aspects 1 to 30.

[0097] Aspect 34: A computer program product comprising: instructions or code for performing one or more of the operations described in aspects 1 to 30.

[0098] While the foregoing disclosure provides examples and descriptions, it is not intended to be exhaustive or to limit the aspects to the precise form disclosed. Modifications and variations may be made based on the foregoing disclosure, or from various forms of practice.

[0099] As used herein, the term "component" is intended to be interpreted broadly as hardware and / or a combination of hardware and software. Whether referred to as software, firmware, middleware, microcode, hardware description language, or other names, "software" should be interpreted broadly as meaning instructions, instruction sets, code, code segments, program code, programs, subroutines, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, and / or functions, etc. As used herein, a "processor" is implemented in hardware and / or a combination of hardware and software. It will be apparent to those skilled in the art that the systems and / or methods described herein can be implemented in various forms of hardware and / or combinations of hardware and software. The actual dedicated control hardware or software code used to implement these systems and / or methods is not limiting in any way. Therefore, no specific software code is referenced in this document to describe the operation and behavior of the systems and / or methods, as those skilled in the art will understand that the software and hardware can be designed, at least in part, based on the descriptions herein, to implement the systems and / or methods.

[0100] As used in this article, depending on the context, "meeting the threshold" can mean a value greater than the threshold, greater than or equal to the threshold, less than the threshold, less than or equal to the threshold, equal to the threshold, not equal to the threshold, etc.

[0101] Although specific combinations of features are set forth in the claims and / or disclosed in the specification, these combinations are not intended to limit the disclosure of various aspects. Many of these features may be combined in ways not specifically set forth in the claims and / or not disclosed in the specification. The disclosure of various aspects includes each dependent claim in combination with each other claim in the set of claims. As used herein, the phrase referring to “at least one of” the list of items means any combination of these items, including a single member. As an example, “at least one of a, b, or c” is intended to cover: a, b, c, a+b, a+c, b+c, and a+b+c, as well as any combination having multiple identical elements (e.g., a+a, a+a+a, a+a+b, a+a+c, a+b+b, a+c+c, b+b, b+b+b, b+b+c, c+c, and c+c+c, or any other ordering of a, b, and c).

[0102] No element, action, or instruction used herein should be construed as essential or necessary unless explicitly stated otherwise. Furthermore, as used herein, the articles “a” and “an” are intended to include one or more items and are used interchangeably with “one or more.” Furthermore, as used herein, the article “described” is intended to include one or more items mentioned in connection with the article “described” and is used interchangeably with “one or more.” Furthermore, as used herein, the terms “collection” and “group” are intended to include one or more items and are used interchangeably with “one or more.” If only one item is desired, the phrase “only one” or similar terminology will be used. Furthermore, as used herein, the terms “have,” “possess,” “have,” etc., are intended to be open-ended terms that do not limit the elements they modify (e.g., an element “having” A may also have B). Furthermore, the phrase “based on” is intended to mean “at least partially based on” unless otherwise explicitly stated. Furthermore, as used herein, the term “or” is intended to be inclusive when used in a series and is interchangeable with “and / or” unless otherwise explicitly stated (e.g., in the case of its use in conjunction with “any” or “only one”).

Claims

1. A method for haptic mixing by an electronic device, the method comprising: Receive multiple tactile signals associated with multiple tactile events, wherein the multiple tactile events overlap in the time domain; Generate a hybrid tactile signal, which combines multiple tactile signals in the mechanical acceleration domain, wherein the hybrid tactile signal stores timing or synchronization information associated with the multiple tactile signals; as well as An output stream is generated to be provided to a tactile actuator, wherein the output stream includes a pulse code modulation (PCM) voltage signal based on the hybrid tactile signal combining the plurality of tactile signals.

2. The method of claim 1, wherein one or more of the plurality of tactile events are discrete tactile events associated with a tactile waveform, the tactile waveform being associated with one or more waveform designer (WFD) parameters.

3. The method of claim 1, wherein one or more of the plurality of tactile events are audio-to-tactile events associated with an audio stream.

4. The method according to claim 1, further comprising: Receive a second plurality of tactile signals associated with a second plurality of tactile events, the second plurality of tactile events overlapping in the time domain; A second hybrid tactile signal is generated, which combines the second plurality of tactile signals in the mechanical acceleration domain, wherein the second hybrid tactile signal stores timing or synchronization information associated with the second plurality of tactile signals; as well as A second output stream is generated, the second output stream being provided to a second tactile actuator, wherein the second output stream includes a second PCM voltage signal, the second PCM voltage signal being based on a second hybrid tactile signal combining the second plurality of tactile signals.

5. The method of claim 1, wherein the plurality of tactile signals are combined to generate the hybrid tactile signal in the mechanical acceleration domain based on configuration data including one or more parameters associated with the tactile actuator.

6. The method of claim 1, wherein an overlap algorithm is used to generate the hybrid tactile signal such that, for each moment during which the plurality of tactile events overlap in the time domain, the hybrid tactile signal includes an amplitude corresponding to the maximum value of the acceleration parameter multiplied by the weighting parameter across the plurality of tactile signals.

7. The method of claim 1, wherein a weighted sum algorithm is used to generate the hybrid tactile signal such that for each moment during which the plurality of tactile events overlap in the time domain, the hybrid tactile signal includes an amplitude corresponding to the sum of acceleration parameters multiplied by weighting parameters across the plurality of tactile signals.

8. The method of claim 1, wherein the hybrid tactile signal is generated using a weighted average algorithm such that, for each moment during which the plurality of tactile events overlap in the time domain, the hybrid tactile signal includes an amplitude corresponding to a first sum of acceleration parameters multiplied by weighting parameters across the plurality of tactile signals divided by a second sum of the weighting parameters across the plurality of tactile signals.

9. An electronic device for wireless communication, the electronic device comprising: One or more memory units; and One or more processors, said one or more processors coupled to said one or more memories, said one or more processors being configured to cause the electronic device to: Receive multiple tactile signals associated with multiple tactile events, wherein the multiple tactile events overlap in the time domain; Generate a hybrid tactile signal, which combines multiple tactile signals in the mechanical acceleration domain, wherein the hybrid tactile signal stores timing or synchronization information associated with the multiple tactile signals; as well as An output stream is generated to be provided to a tactile actuator, wherein the output stream includes a pulse code modulation (PCM) voltage signal based on the hybrid tactile signal combining the plurality of tactile signals.

10. The electronic device of claim 9, wherein one or more of the plurality of tactile events are discrete tactile events associated with a tactile waveform, the tactile waveform being associated with one or more waveform designer (WFD) parameters.

11. The electronic device of claim 9, wherein one or more of the plurality of tactile events are audio-to-tactile events associated with an audio stream.

12. The electronic device of claim 9, wherein the one or more processors are further configured to cause the electronic device to: Receive a second plurality of tactile signals associated with a second plurality of tactile events, the second plurality of tactile events overlapping in the time domain; Generate a second hybrid tactile signal, which combines the second plurality of tactile signals in the mechanical acceleration domain, wherein the second hybrid tactile signal stores timing or synchronization information associated with the second plurality of tactile signals; and A second output stream is generated, the second output stream being provided to a second tactile actuator, wherein the second output stream includes a second PCM voltage signal, the second PCM voltage signal being based on a second hybrid tactile signal combining the second plurality of tactile signals.

13. The electronic device of claim 9, wherein the plurality of tactile signals are combined to generate the hybrid tactile signal in the mechanical acceleration domain based on configuration data including one or more parameters associated with the tactile actuator.

14. The electronic device of claim 9, wherein an overlap algorithm is used to generate the hybrid haptic signal such that, for each moment during which the plurality of haptic events overlap in the time domain, the hybrid haptic signal includes an amplitude corresponding to the maximum value of the acceleration parameter multiplied by the weighting parameter across the plurality of haptic signals.

15. The electronic device of claim 9, wherein a weighted sum algorithm is used to generate the hybrid haptic signal such that, for each moment during which the plurality of haptic events overlap in the time domain, the hybrid haptic signal includes an amplitude corresponding to the sum of acceleration parameters multiplied by weighting parameters across the plurality of haptic signals.

16. The electronic device of claim 9, wherein the hybrid tactile signal is generated using a weighted average algorithm such that, for each moment during which the plurality of tactile events overlap in the time domain, the hybrid tactile signal includes an amplitude corresponding to a first sum of acceleration parameters multiplied by weighting parameters across the plurality of tactile signals divided by a second sum of the weighting parameters across the plurality of tactile signals.

17. A non-transitory computer-readable medium storing an instruction set for wireless communication, the instruction set comprising: One or more instructions, which, when executed by one or more processors of the electronic device, cause the electronic device to: Receive multiple tactile signals associated with multiple tactile events, wherein the multiple tactile events overlap in the time domain; Generate a hybrid tactile signal, which combines multiple tactile signals in the mechanical acceleration domain, wherein the hybrid tactile signal stores timing or synchronization information associated with the multiple tactile signals; as well as An output stream is generated to be provided to a tactile actuator, wherein the output stream includes a pulse code modulation (PCM) voltage signal based on the hybrid tactile signal combining the plurality of tactile signals.

18. The non-transitory computer-readable medium of claim 17, wherein one or more of the plurality of tactile events are discrete tactile events associated with a tactile waveform associated with one or more waveform designer (WFD) parameters.

19. The non-transitory computer-readable medium of claim 17, wherein one or more of the plurality of tactile events are audio-to-tactile events associated with an audio stream.

20. The non-transitory computer-readable medium of claim 17, wherein one or more instructions further cause the electronic device to: Receive a second plurality of tactile signals associated with a second plurality of tactile events, the second plurality of tactile events overlapping in the time domain; Generate a second hybrid tactile signal, which combines the second plurality of tactile signals in the mechanical acceleration domain, wherein the second hybrid tactile signal stores timing or synchronization information associated with the second plurality of tactile signals; and A second output stream is generated, the second output stream being provided to a second tactile actuator, wherein the second output stream includes a second PCM voltage signal, the second PCM voltage signal being based on a second hybrid tactile signal combining the second plurality of tactile signals.

21. The non-transitory computer-readable medium of claim 17, wherein the plurality of tactile signals are combined to generate the hybrid tactile signal in the mechanical acceleration domain based on configuration data including one or more parameters associated with the tactile actuator.

22. The non-transitory computer-readable medium of claim 17, wherein an overlap algorithm is used to generate the hybrid tactile signal such that, for each moment during which the plurality of tactile events overlap in the time domain, the hybrid tactile signal includes an amplitude corresponding to the maximum value of the acceleration parameter multiplied by the weighting parameter across the plurality of tactile signals.

23. The non-transitory computer-readable medium of claim 17, wherein a weighted sum algorithm is used to generate the hybrid tactile signal such that, for each moment during which the plurality of tactile events overlap in the time domain, the hybrid tactile signal includes an amplitude corresponding to the sum of acceleration parameters multiplied by weighting parameters across the plurality of tactile signals.

24. The non-transient computer-readable medium of claim 17, wherein the hybrid tactile signal is generated using a weighted average algorithm such that, for each moment during which the plurality of tactile events overlap in the time domain, the hybrid tactile signal includes an amplitude corresponding to a first sum of acceleration parameters multiplied by weighting parameters across the plurality of tactile signals divided by a second sum of the weighting parameters across the plurality of tactile signals.

25. An apparatus for wireless communication, the apparatus comprising: A component for receiving multiple tactile signals associated with multiple tactile events, wherein the multiple tactile events overlap in the time domain; A component for generating a hybrid tactile signal, which combines multiple tactile signals in a mechanical acceleration domain, wherein the hybrid tactile signal stores timing or synchronization information associated with the multiple tactile signals; and Components for generating an output stream to be provided to a tactile actuator, wherein the output stream includes a pulse code modulation (PCM) voltage signal based on a hybrid tactile signal combining the plurality of tactile signals.

26. The apparatus of claim 25, wherein one or more of the plurality of tactile events are discrete tactile events associated with a tactile waveform associated with one or more waveform designer (WFD) parameters.

27. The apparatus of claim 25, wherein one or more of the plurality of tactile events are audio-to-tactile events associated with an audio stream.

28. The apparatus of claim 25, further comprising: Components for receiving a second plurality of tactile signals associated with a second plurality of tactile events, the second plurality of tactile events overlapping in the time domain; A component for generating a second hybrid tactile signal, the second hybrid tactile signal combining the second plurality of tactile signals in the mechanical acceleration domain, wherein the second hybrid tactile signal stores timing or synchronization information associated with the second plurality of tactile signals; and Components for generating a second output stream to be provided to a second tactile actuator, wherein the second output stream includes a second PCM voltage signal based on a second hybrid tactile signal combining the second plurality of tactile signals.

29. The apparatus of claim 25, wherein the plurality of tactile signals are combined to generate the hybrid tactile signal in the mechanical acceleration domain based on configuration data including one or more parameters associated with the tactile actuator.

30. The apparatus of claim 25, wherein the hybrid tactile signal is generated using an overlap algorithm, a weighted sum algorithm, or a weighted average algorithm.

Images