Verbal output of written communications in the voice of a sender

Abstract

A method comprising: - Receiving text data on an information handling device; - Determining, using a processor, that a sender of the text data is an unknown user; - Generating a voice profile for the unknown user, using a processor, wherein the voice profile is associated with a telephone number of the unknown user sending the text data, and wherein the voice profile is updated based on subsequent voice input from telephone conversations with the user associated with the voice profile; - Generating a speech output, using a processor, wherein the speech output is adapted based on the voice profile; and - Providing the speech output using a loudspeaker.

Description

BACKGROUND

[0001] Information handling devices (“devices”), for example mobile phones, smartphones, tablets, laptops, and the like, enable users to communicate with other users by sending and receiving written data, such as text messages, emails, notifications, etc. Advances in technology have made it possible to output written data received on these devices audibly to the user (e.g., via text-to-speech software) through a pre-recorded voice. BRIEF SUMMARY

[0002] In summary, one aspect provides a procedure comprising: receiving a specification on an information handling device, generating a speech output; identifying a voice profile using a processor; generating the speech output using a processor, wherein the speech output is adapted based on the voice profile; and providing the speech output using a loudspeaker.

[0003] Another aspect provides an information handling device, comprising: a processor; a loudspeaker; a storage device that stores instructions executable by the processor for: receiving a signal to produce a speech output; identifying a voice profile; producing the speech output, the speech output being adapted based on the voice profile; and providing the speech output.

[0004] Another aspect is a product that provides: a storage device that stores a code, wherein the code is executable by a processor and includes: a code that receives a command to produce a speech output; a code that identifies a voice profile; a code that generates the speech output, wherein the speech output is adapted based on the voice profile; and a code that provides the speech output.

[0005] The foregoing is a summary and may therefore contain simplifications, generalizations and omissions of details; consequently, those familiar with the technique will recognize that the summary is merely descriptive and does not aim to be limiting in any way.

[0006] For a better understanding of the embodiments, along with other features and advantages thereof, reference is made to the following description in conjunction with the accompanying drawings. The scope of the invention is set out in the appended claims. BRIEF DESCRIPTION OF SEVERAL VIEWS OF THE DRAWINGS

[0007] Fig. Figure 1 shows an example of an information handling device circuit.

[0008] Fig. Figure 2 shows another example of an information handling device circuit.

[0009] Fig. Figure 3 shows an example of a method that provides text-to-speech output in a sender's voice. DETAILED DESCRIPTION

[0010] It is readily understood that the components of the embodiments, as generally described herein and shown in the figures, can be arranged and constructed in a wide variety of different configurations, in addition to the exemplary embodiments described. Therefore, the following detailed description of exemplary embodiments, as represented in the figures, is not suitable for limiting the scope of the embodiments as claimed, but merely presents them as exemplary embodiments.

[0011] Any reference in this entire specification to a “single embodiment” or “an embodiment” (or similar) means that a particular feature, structure, or property described in connection with the embodiment is included in at least one embodiment. Therefore, the appearance of the phrases “in a single embodiment” or “in an embodiment” or similar at different points in this specification does not necessarily refer to the same embodiment.

[0012] Furthermore, the described features, structures, or properties can be combined in any suitable way in one or more embodiments. A multitude of specific details are provided in the following description to give a thorough understanding of the embodiments. However, a person skilled in the art will recognize that the different embodiments can be carried out without one or more of the specific details, or with or without methods, components, materials, etc. In other examples, known structures, materials, or methods are not shown or described in detail to avoid confusion.

[0013] Conventional text-to-speech software used on devices (e.g., Siri) ® for Apple ® or Cortana ®(for Windows®) can identify a segment of text data (e.g., by comparing it to an accessible word bank), associate the segment with a previously recorded voice output, and then send the previously recorded voice output to a user (e.g., via a speaker) corresponding to the identified text segment. For example, if a user receives a text message from another user containing the greeting "Hello," a program can identify the word and then output the previously recorded word "Hello" to the user.

[0014] Text-to-speech software can be helpful for users who find themselves in situations where they want to understand the content of received written communication (e.g., text message, email, social media notifications, etc.) but are in an environment where they are unable to visually inspect the written communication. A common example is when a user is driving and cannot take their attention off the road to read a received text message.

[0015] Conventional text-to-speech programs, however, have problems related to the effectiveness and clarity of the voice output. One problem, for example, is that the pre-recorded voice associated with the voice output can only be programmed to provide a voice output of the received text communication in a limited number of dialects (e.g., American English, British English, Australian English, etc.). Individuals unaccustomed to hearing some or all of the dialect options associated with the pre-recorded voice may find it difficult to understand the voice output. Additionally, another problem is that some text-to-speech programs fail to identify and voice the sender's name (namely, the contact name, if available, which is associated with the text communication).The programs that do this may not be able to pronounce the sender's name accurately. For example, if a sender of a text message has an unusual name, the program may not be able to determine a vocal output associated with that name. Alternatively, a program may attempt to associate the vocal output with the unknown name; however, because there is no direct match between the sender's name and any stored vocal output, the result is an incorrect pronunciation of the sender's name. Both situations would cause user confusion because the user would be unable to immediately identify the sender of the written communication.Furthermore, a common complaint from users is that the voice output of conventional text-to-speech programs is too machine-like and, due to the use of pre-recorded, stock audio for voice output, does not provide users with a personal communication experience.

[0016] Accordingly, one embodiment provides a method for outputting the contents of received written communications in a voice associated with the sender of the textual communication. In one embodiment, a voice profile corresponding to the user can be generated using voice input from the user. In another embodiment, the voice profile can be associated with the written communications sent by the user who provides voice input to the voice profile. Therefore, when written communications are received from the user, a device can output the content of the written communication aloud using the generated voice profile and the user's voice.Such a method allows a user of text-to-speech software to immediately identify the sender of a written communication based on the sound of the sender's voice. Additionally, one embodiment provides the user with a better user experience, namely an experience representative of a face-to-face conversation.

[0017] In one embodiment, a voice profile for a second user (e.g., a telephone contact) can be generated on the first user's device using the second user's voice input. In another embodiment, a voice profile for a first user can be generated on the first user's device and shared with other users. In yet another embodiment, the voice profile can be updated based on subsequent voice input.

[0018] The exemplary embodiments shown are best understood by referring to the figures. The following description is intended only as an example and merely illustrates certain exemplary embodiments.

[0019] While various other circuits, circuits or components in information handling devices relate to a smartphone and / or tablet circuit 100 used includes a Fig. The first example shown is a system-on-a-chip design, which can be found, for example, in a tablet or other mobile computing platforms. The software and processor(s) are integrated into a single chip. 110 combined. Processors include internal arithmetic units, registers, cache memory, buses, on / off ports, etc., as are well known in engineering. Internal buses and the like depend on different vendors, but essentially all these peripheral devices (120 ) on a single chip 110 It would be appropriate. The circuit 100 combines the processor, memory control, and an ON / OFF control node together in a single chip 110 Systems also use 100 This type of interface typically does not use SATA, PCI, or LPC. Common interfaces include, for example, SDIO and I2C.

[0020] There are power management chips. 130 e.g. a battery management unit (BMU), which supplies power, for example, via a rechargeable battery 140 It supplies power that is recharged by connecting to a power source (not shown). In at least one design, a single chip is used. 110 used to provide BIOS-like functionality and DRAM memory.

[0021] The system 100 typically includes one or more WWAN transceivers 150 and a WLAN transceiver 160for connecting to various networks, such as telecommunications networks and wireless internet devices, e.g., access points. Additionally, devices are usually included. 120 This includes, for example, an image sensor such as a camera. The system 100 often includes a touchscreen 170 for data input and for display / playback. The system 100 It typically also includes various storage devices, e.g., flash memory. 180 and SDRAM 190 .

[0022] Fig. Figure 2 shows a block diagram of another example of information handling device circuits, circuits, or components. The example shown in Fig. Figure 2 shows that embodiments may correspond to computer systems such as those in the THINKPAD series of personal computers sold by Lenovo (US) Inc. of Morrisville, NC, or other devices. As can be seen from the description herein, embodiments may have other features or only some features of the example shown in Figure 2. Fig. 2 is shown, include.

[0023] The example of Fig. 2 includes a so-called chipset 210(A group of integrated circuits or chips that work together, chipsets) with an architecture that can vary depending on the manufacturer (for example, Intel, AMD, ARM, etc.). Intel is a registered trademark of Intel Corporation in the United States and other countries. AMD is a registered trademark of Advanced Micro Devices Inc. in the United States and other countries. ARM is an unregistered trademark of ARM Holdings plc in the United States and other countries. The chipset architecture 210 includes a core and a memory control group 220 and an ON / OFF control node 250 , which transmits information (for example, data, signals, instructions, etc.) via a Direct Management Interface (DMI) 242 or a connection control unit 244 exchanges. In Fig. 2 is the DMI 242A chip-to-chip interface (sometimes also referred to as a connection between a “northbridge” and a “southbridge”). The core and the memory control group. 220 include one or more processors 222 (for example, single or multi-core) and a memory control node 226 , the information about a front-side bus (FSB) 224 exchange; it should be noted that the components of the group 220 They can be integrated on a single chip, replacing the conventional "northbridge"-type structure. One or more processors. 222 They include internal arithmetic units, registers, cache memory, buses, ON / OFF ports, etc., as are well known in engineering.

[0024] In Fig. 2 forms the storage control node 226 interfaces with the memory 240(for example, to provide support for a type of RAM memory that can be referred to as “system memory” or “memory”). The memory control node 226 It also includes a Low Voltage Differential Signaling (LVDS) interface. 232 for a display device 292 a (for example, a CRT, a flat screen, a touchscreen, etc.). A block 238 includes several technologies that use the LVDS interface 232 Supported interfaces include (for example, serial digital video, HDMI / DVI, display connector). The storage control node 226 This also includes a PCI Express (PCI-E) interface. 234 one, the discrete graphics 236 can provide support.

[0025] In Fig. 2 includes the ON / OFF control node 250 a SATA interface 251 (for example, for HDDs, SSDs, etc.) 280 ), a PCI-E interface 252(for example, for wireless connections) 282 ), a USB interface 253 (for example, for devices) 284 such as a digitizer, keyboard, mouse, cameras, telephones, microphones, storage, other connected devices, etc.), a network interface 254 (for example, LAN), a GPIO interface 255 , an LPC interface 270 (for ASICs) 271 , a TPM 272 , a super on / off control node 273 , a firmware node 274 , BIOS support 275 as well as different types of storage 276 like ROM 277 Flash 278 and NVRAM 279 ), a power management interface 261 , a clock generator interface 262 , an audio interface 263 (for example, for loudspeakers) 294 ), a TCO interface 264 , a system management bus interface 265 and an SPI flash266 , which is a BIOS 268 and a boot code 290 It can include the ON / OFF control node. 250 It can feature Gigabit Ethernet support.

[0026] Once the system is powered on, it can be configured to use a boot code. 290 for the BIOS interface 268 to execute as in the SPI flash 266 is stored, and then processes data under the control of one or more operating systems and application software (which, for example, are stored in the system memory). 240 (is stored). An operating system can be stored in any number of different locations and, for example, according to the instructions of the BIOS. 268 This can be accessed. As described herein, a device may have fewer or more features than those in the system of Fig. 2 are shown, included.

[0027] An information handling device circuit, such as those found in the Fig. 1 and Fig. The circuit shown in Figure 2 can be used in devices such as tablets, smartphones, personal computers in general, and / or electronic devices that allow users to perform text-to-speech functions. For example, the circuit shown in Figure 2 can be used in such devices. Fig. 1 is shown, implemented in a tablet or smartphone version, with the circuit shown in Fig. 2, which is shown, can be implemented in a personal computer execution form.

[0028] Now, referring to Fig. 3. One embodiment may be 301Receiving text data on a device. In one embodiment, a user can receive written communications from another user (“sender”), which include text messages, emails, social media notifications, etc. In one embodiment, an identity profile associated with the sender can be created by the user. The identity profile can include details about the sender, such as the sender's first and last name. In one embodiment, when a written communication is received from the sender, the sender's identity (e.g., first and last name) can appear simultaneously with the structure of the text message. For example, a user can create an identity profile of their friend “Meghan Smith” so that when the user's friend sends the user a text message, “Meghan Smith” can appear above the body of the text message, indicating the sender's identity.In one embodiment, the identity profiles of different senders can be stored in a list format (e.g., a contact list). The list can be stored in a location that is either local (e.g., on the device) or accessible in another location (e.g., cloud storage).

[0029] After a textual communication is received from a sender, an embodiment can be used in the following ways: 302The received text data is associated with a voice profile. In one embodiment, the voice profile can include learned aspects of a user's voice (e.g., pitch, tone, accent, etc.). Another embodiment can associate written communications received from a sender with a voice profile, so that the written communications can be spoken aloud using the sender's voice (e.g., via text-to-speech software), for example, by using a customized speech output model adapted using the learned aspects of the sender's voice.

[0030] In one embodiment, a voice profile can be generated for each sender in a user contact list. In another embodiment, the voice profile can be generated automatically or only after a user request. For example, one embodiment can automatically generate a voice profile for each new sender for whom a user has created an identity profile. Alternatively, a user can, for example, toggle a switch (e.g., in a sender's identity profile) to specify that a voice profile should be generated for that individual user. In another embodiment, when a user receives written communication from an unknown sender (i.e., a sender for whom the user has not created an identity profile), the user is presented with an option (e.g., a dialog box) asking whether they want to create a voice profile for the unknown sender.In one embodiment, the voice profile can be associated with the telephone number of the unknown sender.

[0031] In one embodiment, the voice profile can be updated based on subsequent voice inputs. If a particular voice profile is updated and multiple sample data for the sender's voice identifiers are available, one embodiment will be able to more accurately duplicate the voice of the user with whom the profile is associated when written communications are output in audible form. For example, in one embodiment, a new voice profile for an individual can output written communications from that individual in a machine-like voice. In contrast, a voice profile for an individual that has been frequently updated can output written communications in a voice similar to that of the individual. In another embodiment, updating the voice profile can involve introducing subsequent voice inputs from a user associated with the voice profile.For example, one implementation can use the voice inputs sent by a user each time they have a telephone conversation with another individual for whom a voice profile has been created, to update the voice profile associated with that individual.

[0032] In one embodiment, a voice profile can be generated for a user, which is updated whenever the user sends any kind of voice input (e.g., phone conversations, recordings, voice notes, etc.) to the device. For example, in one embodiment, each time a user calls an individual on their contact list, the user's voice input during the call can be used to update the user's voice profile. In another embodiment, the user's voice profile can be stored in a location that the device can access (e.g., locally or via cloud storage). In yet another embodiment, the user's voice profile can be automatically shared with other users' devices by a user setting.For example, in one embodiment, a user's voice profile can be automatically sent to another user's device based on the detection of a predetermined event (e.g., when the other user is added to a user contact list or vice versa). In another example, a user can upload their voice profile to a storage location (e.g., cloud storage) where it is accessible for download by other users.

[0033] In one embodiment, when written communication is received on a user's device, the written communication can be associated with the sender's voice profile. For example, if a text message is received from the saved contact, Meghan Smith, only the voice data associated with Meghan Smith's corresponding voice profile can be used to output the text message. This ensures that the embodiment does not resort to incorrect voice profiles when the written communication is output.

[0034] At 303In one embodiment, the output can be sent to a user to receive written communication with a voice similar to the sender's voice. In one embodiment, the output can be a text-to-speech output that audibly reproduces (e.g., through a device's speaker) the contents of the received written communication. In another embodiment, the output can be audibly reproduced using the sender's voice, employing the voice data in the sender's corresponding voice profile. For example, if a text message is received from the contact, Meghan Smith, stating, "Hello, how are you?", one embodiment can access the voice profile associated with Meghan Smith to audibly reproduce the aforementioned sentence in a voice similar to Meghan Smith's.

[0035] In one embodiment, a device can automatically output received text data after receiving it. In some situations, it may be advantageous for an embodiment to output the received text data after receiving it. For example, in situations where users are unable to visually inspect their device (e.g., while driving), it may be advantageous for an embodiment to automatically output the contents of the received text to the user. Alternatively, in other situations, a user may not want received written communication to be output audibly (e.g., during a business meeting). Therefore, in one embodiment, a user can enable / disable the automatic text-to-speech functions for the system. Alternatively, in another embodiment, a user can automatically enable / disable text-to-speech functions for a specific user.For example, a user can enable automatic text-to-speech functions only for contact with Meghan Smith.

[0036] From the description provided herein, it is clear that one embodiment tunes a voice model to replicate a user's distinctive speech characteristics, thus providing an audio output that more closely resembles the user's unique voice sound. This can be applied to text-to-speech systems as well as any other system that uses machine-generated human voice output. For example, one embodiment can be implemented to provide synthetic speech output that resembles a specific user in navigation systems, information kiosks, and so on.

[0037] The various embodiments described herein thus represent a technical improvement on conventional text-to-speech systems and / or systems that produce human speech output. Using the methods described herein, a user may be able to immediately identify the identity of a sender of written communication. One embodiment provides the user with an output of any received written communication in the voice of the sender of the written communication.

[0038] As is evident to a person skilled in the art, different aspects can be embodied in a system, a process, or a device program product. Accordingly, aspects can take the form of a complete hardware implementation or an embodiment that includes software, which is generally referred to herein as a “circuit,” “module,” or “system.” Furthermore, aspects can take the form of a device program product contained in one or more device-readable media that embody device-readable program code.

[0039] It should be noted that various functions described herein may be implemented using instructions stored on a device-readable storage medium, such as a non-signal storage device, and executed by a processor. A storage device may be, for example, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any suitable combination of the foregoing. More specific examples of a storage medium include the following: a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.In the context of this document, a storage device is not a signal and, in the sense of being non-transient, includes all media other than signal media.

[0040] Program code that exists on a storage medium can be transferred using a suitable medium, which includes but is not limited to wireless, wired, fiber optic cable, RF, etc., or any suitable combination of the foregoing.

[0041] Program code can perform operations written in any combination of one or more programming languages. The program code can run entirely on a single device, partially on a single device, as a standalone software package, partially on a single device and partially on another device, or entirely on another device. In some cases, the devices may be connected by some kind of connection or network, including a local area network (LAN) or a wide area network (WAN), or the connection may be established through other devices (for example, via the internet using an internet service provider), by wireless connection, such as near-field communication (NFC), or by a wired connection, such as a USB connection.

[0042] This document describes exemplary embodiments with reference to the figures, which represent exemplary methods, devices, and program products according to different exemplary embodiments. It is understood that the actions and functionality can be implemented, at least in part, by program instructions. These program instructions can be provided to a processor of a device, a special-purpose information processing device, or other programmable data processing devices to create a machine, so that the instructions, executed by a processor of the device, perform the specified functions / actions.

[0043] It is important to note that while certain blocks are used in the figures and a specific arrangement of blocks is shown, these are not limiting examples. In certain contexts, two or more blocks may be combined, a block may be divided into two or more blocks, or certain blocks may be rearranged or reorganized appropriately, as the examples explicitly shown are used for descriptive purposes only and are not to be interpreted as limiting.

[0044] As it is used herein, the singular “ein” and “eine” can be interpreted as including a plural such as “one or more”, unless expressly stated otherwise.

[0045] This disclosure has been presented for illustrative and descriptive purposes; however, it is not intended to be exhaustive or limiting. Many modifications and variations will be obvious to the person skilled in the art. The exemplary embodiments have been selected to describe the principles and practical applications and to enable others with expert knowledge of the prior art to understand the disclosure of the different embodiments with different modifications suitable for the particular use under consideration.

[0046] It is therefore understandable that this description, although exemplary embodiments shown herein are described with reference to the accompanying drawings, is not limiting and that various other changes and modifications can be applied to it by a person skilled in the art without deviating from the scope of protection and the spirit of the disclosure.

Claims

[1] Procedure, encompassing: – Receiving a signal on an information handling device and producing a spoken output; – Identifying a voice profile using a processor; – Generating the speech output using a processor, where the speech output is adapted based on the voice profile; and – Providing spoken output using a loudspeaker. [2] Method according to claim 1, further comprising receiving text data, wherein the voice profile is associated with a user who sends the text data. [3] Method according to claim 2, wherein the provisioning comprises providing an output after receiving the text data. [4] Method according to claim 2, wherein the text data is derived from a communication selected from the group consisting of: a text message, an email and a social media notification. [5] Method according to claim 1, further comprising recording a voice input from a user and generating a voice profile using the voice input of the user. [6] Method according to claim 5, comprising updating the voice profile based on subsequent voice inputs. [7] Method according to claim 1, wherein the voice profile on the information handling device is received by another device. [8] Method according to claim 1, wherein the voice profile is stored in a storage location which the information handling device can access. [9] Method according to claim 1, comprising automatically generating a voice profile for each user who is added to a user's contact list. [10] Method according to claim 1, comprising sending a voice profile to another device based on a predefined event. [11] Information handling device, comprising: a processor; – a loudspeaker; – a storage device that stores instructions that can be executed by the processor, for: – Receiving a command to generate a speech output; – Identifying a voice profile; Generating the speech output, where the speech output is adapted based on the voice profile; and – Providing the language output. [12] Information handling device according to claim 11, wherein the instructions are executable by the processor to receive text data, wherein the voice profile is associated with a user who sends the text data. [13] Information handling device according to claim 12, wherein the speech output is provided after receiving the text data. [14] Information handling device according to claim 12, wherein the text data is derived from a communication selected from the group consisting of: a text message, an email and a social media notification. [15] Information handling device according to claim 11, wherein the instructions are executable by the processor to record voice input from a user and to generate a voice profile using the user's voice input. [16] Information handling device according to claim 15, wherein the instructions can be executed by the processor to update the voice profile based on subsequent voice inputs. [17] Information handling device according to claim 11, wherein the voice profile on the information handling device is received by another device. [18] Information handling device according to claim 11, wherein the voice profile is stored in a storage location which the information handling device can access. [19] Information handling device according to claim 11, wherein the instructions are executable by the processor to automatically generate a voice profile for each user who is added to a user's contact list. [20] Product encompassing: – a storage device that stores code, wherein the code is executable by a processor and comprises: – to generate a speech output from a code that receives a command; – a code that identifies a voice profile; – a code that generates the speech output, the speech output being adapted based on the voice profile; and – a code that provides the spoken output.

Images