System for voice-activated function execution and method employed thereof
The system addresses the complexity of mobile devices by enabling voice-activated function execution through natural language processing and speech recognition, offering a hands-free, portable, and efficient user experience that integrates with various applications and industries.
Patent Information
- Application Number
- PCT/IB2024/055255
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-31
- Filing Date
- 2024-05-30
- Publication Date
- 2024-12-05
AI Technical Summary
Current mobile devices are complex and inefficient to use, especially for users with mobility issues, as they require physical interaction and do not seamlessly integrate with third-party applications using voice commands, limiting hands-free experiences.
A system that enables voice-activated function execution through natural language processing and speech recognition, allowing users to interact with computing devices using minimal hardware and software, with data stored on a server, enabling hands-free operation and integration with various applications without app development on mobile devices.
Provides a more intuitive, efficient, and portable user experience, allowing hands-free interaction with multiple functions, extending battery life, and integrating with various industries like healthcare and gaming, while reducing maintenance costs and complexity.
Smart Images

Figure IB2024055255_05122024_PF_FP_ABST
Abstract
Description
“SYSTEM FOR VOICE-ACTIVATED FUNCTION EXECUTION AND METHOD EMPEOYED THEREOF”TECHNICAL FIELD
[0001] The present disclosure generally relates to the field of speech recognition systems. More particularly, the present disclosure relates to a system for voice-activated function execution and method employed thereof. Additionally, the present disclosure provides an intelligent solution for hands-free control of electronic devices.BACKGROUND
[0002] In today's world, mobile devices have become an essential part of our daily lives, allowing us to stay connected, work, access information on the go, and execute functions, the functions may include ordering food or booking a ride and the like. However, interacting with mobile devices can often be complex and time-consuming, requiring users to navigate through menus and remember complex commands. The complexity of using current mobile devices creates a technical problem that affects user experience and efficiency. This complexity is a significant technical problem that limits the efficiency and intuitiveness of mobile devices. As mobile devices continue to become more advanced and feature-rich, the problem of complexity will only become more significant.
[0003] Existing solutions to the problem of smartphone portability and the complexity of using current mobile devices, such as wearable devices like smartwatches and fitness trackers, or foldable phones, still require users to carry a physical device. These solutions operate using the apps installed on them, which may not be sufficient for users with mobility or accessibility issues. Virtual assistants like Siri or Google Assistant allow users to perform tasks using voice commands, but they require a physical device to interact with the assistant. Additionally, these assistants may not work with a lot of useful and commonly used apps like Swiggy, MakeMyTrip, BookMyShow, and IRCTC / iXigo, which limits their hands-free experience. To address these technical problems, there have been previous attempts to use speech recognition and natural language processing in mobile devices. However, none of these attempts have fully integrated with third-party applications and provided continuous learning and adaptation to user behaviour.
[0004] In the light of the aforementioned discussion, there exists a need for a certain system with novel methodologies that would overcome the above-mentioned disadvantages.SUMMARY
[0005] The following presents a simplified summary of the disclosure in order to provide a basic understanding to the reader. This summary is not an extensive overview of the disclosure and it does not identify key / critical elements of the invention or delineate the scope of the invention. Its sole purpose is to present some concepts disclosed herein in a simplified form as a prelude to the more detailed description that is presented later.
[0006] Exemplary embodiments of the present disclosure are directed towards a system for voice-activated function execution and method employed thereof.
[0007] An objective of the present disclosure is directed towards providing a more intuitive and efficient way for a user to interact with mobile / communication devices.
[0008] Another objective of the present disclosure is directed towards a system that enables the user to make calls, send messages, check their calendar, order food, book a ride, and perform other functions through natural language voice commands.
[0009] Another objective of the present disclosure is directed towards providing natural language processing and speech recognition technology used to solve the problem.
[0010] Another objective of the present disclosure is directed towards a system that is fully portable, provides a hands-free experience, and stores all data on a server.
[0011] Another objective of the present disclosure is directed towards a system that is user- friendliness and provides a conversational experience.
[0012] Another objective of the present disclosure is directed towards providing a computing device with minimal hardware and software, making it less prone to failure and cheaper to maintain.
[0013] Another objective of the present disclosure is directed towards providing a serverbased process it allows for more efficient use of resources and extends battery life.
[0014] Another objective of the present disclosure is directed towards a system that provides a hands-free and conversational smartphone experience for the user.
[0015] Another objective of the present disclosure is directed towards a system that eliminates the need for app development and installation on mobile devices.
[0016] Another objective of the present disclosure is directed towards a system that allows the user to perform various functions / tasks without physically interacting with the mobile device.
[0017] Another objective of the present disclosure is directed towards a system that enables true device portability and stores data on the server's cloud database.
[0018] Another objective of the present disclosure is directed towards a system that enables the warehouses / factories workers to communicate with colleagues or access data without using their hands in a hands-free way mode.
[0019] Another objective of the present disclosure is directed towards a system that easily integrates with the development of brain-computer interfaces.
[0020] Another objective of the present disclosure is directed towards a system that easily integrates with the gaming industry to create immersive gaming experiences.
[0021] Another objective of the present disclosure is directed towards a system that enables healthcare professionals to access medical data or communicate with patients without touching their devices.
[0022] Another objective of the present disclosure is directed towards a system that enables employees to access data or communicate with colleagues through natural language voice commands without using their hands.
[0023] Another objective of the present disclosure is directed towards a system that enables students to access educational content or communicate with teachers through natural language voice commands without using their hands.
[0024] According to an exemplary aspect of the present disclosure, enabling the user to interact with a computing device using natural language voice commands by a communication module.
[0025] According to another exemplary aspect of the present disclosure, sending the natural language voice commands to a server from the computing device by the communication module over a network.
[0026] According to another exemplary aspect of the present disclosure, receiving the natural language voice commands by a user integration module enabled in the server.
[0027] According to another exemplary aspect of the present disclosure, processing the natural language voice commands by the user integration module using a natural language processing technique.
[0028] According to another exemplary aspect of the present disclosure, interpreting the processed natural language voice commands by the user integration module using speech recognition techniques and conversational platforms.
[0029] According to another exemplary aspect of the present disclosure, executing a function from one or more third party applications by the user integration module over an application programming interface (API) based on natural language voice commands.
[0030] According to another exemplary aspect of the present disclosure, sending an appropriate response to the computing device from the user integration module over the network.BRIEF DESCRIPTION OF THE DRAWINGS
[0031] In the following, numerous specific details are set forth to provide a thorough description of various embodiments. Certain embodiments may be practiced without thesespecific details or with some variations in detail. In some instances, certain features are described in less detail so as not to obscure other aspects. The level of detail associated with each of the elements or features should not be construed to qualify the novelty or importance of one feature over the others.
[0032] FIG. 1 is a block diagram depicting a schematic representation of a system for voice- activated function execution, in accordance with one or more exemplary embodiments.
[0033] FIG. 2 is a block diagram depicting an embodiment of the communication module 108 on the computing device and the user integration module 110 on the server as shown in FIG. 1, in accordance with one or more exemplary embodiments.
[0034] FIG. 3 is an example diagram depicting a system architecture for voice-activated function execution, in accordance with one or more exemplary embodiments.
[0035] FIG. 4 is an exemplary embodiment of the voice-activated function execution system as shown in FIG. 1, in accordance with one or more exemplary embodiments.
[0036] FIG. 5 is a flowchart depicting an exemplary method for voice-activated function execution, in accordance with one or more exemplary embodiments.
[0037] FIG. 6 is a block diagram illustrating the details of a digital processing system in which various aspects of the present disclosure are operative by execution of appropriate software instructions.DETAILED DESCRIPTION OF EXAMPLE EMBODIMENTS
[0038] It is to be understood that the present disclosure is not limited in its application to the details of construction and the arrangement of components set forth in the following description or illustrated in the drawings. The present disclosure is capable of other embodiments and of being practiced or of being carried out in various ways. Also, it is to be understood that the phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting.
[0039] The use of “including”, “comprising” or “having” and variations thereof herein is meant to encompass the items listed thereafter and equivalents thereof as well as additional items. The terms “a” and “an” herein do not denote a limitation of quantity, but rather denote the presence of at least one of the referenced items. Further, the use of terms “first”, “second”, and “third”, and the like, herein do not denote any order, quantity, or importance, but rather are used to distinguish one element from another.
[0040] Referring to FIG. 1 is a block diagram 100 depicting a schematic representation of a system for voice-activated function execution, in accordance with one or more exemplary embodiments. The system 100 includes a computing device 102, a network 104, a server 106, a communication module 108, a user integration module 110, a first third party application 112, a second third party application 114, an Nththird party application 116, a cloud database server 118, and a cloud database 120.
[0041] The computing device 102 may be operated by a user. The user may include but not limited to individual users, a student, a doctor, a lawyer, an employee, healthcare professionals, warehouses / factories workers, and the like. The computing device 102 may be communicatively connected to the server 106 over the network 104. The network 104 may include, but not limited to, an Internet of things (loT network devices), an Ethernet, a wireless local area network (WLAN), or a wide area network (WAN), a Bluetooth low energy network, a ZigBee network, a WIFI communication network e.g., the wireless high speed internet, or a combination of networks, a cellular service such as a 4G (e.g., LTE, mobile WiMAX) or 5G cellular data service, a RFID module, a NFC module, wired cables, such as the world-wide -web based Internet, or other types of networks may include Transport Control Protocol / Intemet Protocol (TCP / IP) or device addresses (e.g. network-based MAC addresses, or those provided in a proprietary networking protocol, such as Modbus TCP, or by using appropriate data feeds to obtain data from various web services, including retrieving XML data from an HTTP address, then traversing the XML for a particular node) and so forth without limiting the scope of the present disclosure.
[0042] The computing device 102 may include the communication module 108. The communication module 108 may be any suitable applications downloaded from GOOGLE PLAY® (for Google Android devices), Apple Inc.'s APP STORE® (for Apple devices), or any other suitable database. The communication module 108 may be a desktop application which runs on Windows or Linux or any other operating system and may be downloadedfrom a webpage or a CD / USB stick etc. In some embodiments, the communication module 108 may be software, firmware, or hardware that is integrated into the computing device 102. The computing device 102 may present a web page to the user by way of a browser, wherein the webpage comprises a hyper-link may direct the user to uniform resource locator (URL). The communication module 108 may be configured to enable the user to interact with the computing device 102 by natural language voice commands to execute a function. The function may include but not limited to ordering food, booking a ride, booking movie tickets, booking train tickets, booking bus tickets, and ordering products from Myntra, Flipkart, amazon, and the like. The communication module 108 may be configured to send the natural language voice commands to the server 106. The server 106 may include the user integration module 110. The user integration module 110 may be configured to receive the natural language voice commands from the communication module 108. The user integration module 110 may be configured to interpret the natural language voice commands using speech recognition and the natural language processing technologies. The user integration module 110 may also use conversational platforms. The conversational platforms may include but not limited to Chat GPT and the like. The user integration module 110 may be trained by the artificial intelligence. The user integration module 110 may be configured to execute the function, the function may include ordering food, booking a ride, booking movie tickets, booking train tickets, booking bus tickets, and ordering products from third party applications 112, 114, 116 through the application programming interfaces (API’s). The cloud database server 118 may be configured to access the one or more databases. The cloud database 120 may be configured to store user data.
[0043] Referring to FIG. 2 is a block diagram 200 depicting an embodiment of the communication module 108 on the computing device and the user integration module 110 on the server as shown in FIG. 1, in accordance with one or more exemplary embodiments. The communication module 108 includes a bus 201a, a voice recording module 202, and a video recording module 204. The bus 201a may include a path that permits communication among the modules of the communication module 108 installed on the computing device 102. The term “module” is used broadly herein and refers generally to a program resident in the memory of the computing device 102. The voice recording module 202 may be configured to enable the user to interact with the computing device 102 by natural language voice commands to execute a function. The function may include but not limited to ordering food, booking a ride, booking movie tickets, booking train, booking bus tickets, and orderingproducts from Myntra, Flipkart, amazon, and the like. The voice recording module 202 may be configured to send the natural language voice commands to the server 106 over the network 104. The video recording module 204 may be configured to enable the user to capture images and videos on the computing device 102.
[0044] In accordance with one or more exemplary embodiments of the present disclosure, the user integration module 110 includes a bus 201b, a speech processing module 206, a speech recognition module 208, and a bookings and orders placing module 210. The bus 201b may include a path that permits communication among the modules of the user integration module 110 installed on the server 106. The speech processing module 206 may be configured to process the natural language voice commands of the user using the natural language processing technologies. The speech recognition module 208 may be configured to interpret the natural language voice commands using speech recognition technologies. The speech recognition module 208 may also use the conversational platforms. The conversational platforms may include but not limited to Chat GPT and the like. The speech recognition module 208 may be trained by the artificial intelligence. The bookings and orders placing module 210 may be configured to execute the function, the function may include ordering food, booking a ride, booking movie tickets, booking train, booking bus tickets, and ordering products from third party applications 112,114, 116 through the application programming interfaces of the third-party applications 112,114, 116.
[0045] Referring to FIG. 3 is an example diagram 300 depicting a system architecture for voice-activated function execution, in accordance with one or more exemplary embodiments. The system 300 includes a computing device 302, a server 304, third party applications 306, 308, 310, a communication module 312, a display unit 314, a camera 316, a GPS unit 318, sensors 320, a mic 322, a speaker 324, a WIFI / Bluetooth 326, and a user integration module 328.
[0046] The computing device 302 may include minimal hardware and software to monitor the physical parameters of the user body or the environment. The camera 316 may be configured to enable the user to capture images and videos. The camera 316 may also be configured to recognize the user through facial recognition. The mic 322 may be configured to capture the user's voice commands. The Speaker 322 may be configured to provide audio feedback to the user. The sensors 320 may be configured to monitor the physical parametersof the user's body or environment. The communication module 312 may be configured to enable the user to interact with the computing device 302 by natural language voice commands to execute a function. The function may include but not limited to ordering food, booking a ride, booking movie tickets, booking train, booking bus tickets, and ordering products from Myntra, Flipkart, amazon, and the like. The communication module 312 may be configured to send the natural language voice commands to server 304. The server 304 may include the user integration module 328. The user integration module 328 may be configured to receive the natural language voice commands from the communication module 312. The user integration module 328 may be configured to interpret the natural language voice commands using speech recognition and the natural language processing technologies. The user integration module 328 may also use conversational platforms. The conversational platforms may include but not limited to Chat GPT and the like. The user integration module 328 may be trained by the artificial intelligence. The user integration module 328 may be configured to execute the function, the function may include ordering food, booking a ride, booking movie tickets, booking train, booking bus tickets, and ordering products from third party applications 306, 308, 310 over the APIs ( Application programming interfaces).
[0047] Referring to FIG. 4 is an exemplary embodiment of the voice-activated function execution system as shown in FIG. 1, in accordance with one or more exemplary embodiments. The computing device 402 may include minimal hardware and software to monitor the physical parameters of the user body or the environment. The camera 418 may be configured to enable the user to capture images and videos. The camera 418 may also be configured to recognize the user through facial recognition. The mic 416 may be configured to capture the user's voice commands. The speaker 420 may be configured to provide audio feedback to the user. The sensors 422 may be configured to monitor the physical parameters of the user's body or environment. The communication module 430 may be configured to enable the user to interact with the computing device 402 by natural language voice commands to execute the function. The function may include but not limited to ordering food, booking a ride, booking movie tickets, booking train, booking bus tickets, and ordering products from Myntra, Flipkart, amazon, and the like. The communication module 430 may be configured to send the natural language voice commands to server 304. The server 404 may include the user integration module 406. The user integration module 406 may be configured to receive the natural language voice commands from the communication module 430. The user integration module 406 may be configured to interpret the natural languagevoice commands using speech recognition and the natural language processing technologies. The user integration module 406 may also use the conversational platforms. The conversational platforms may include but not limited to Chat GPT and the like. The user integration module 406 may be trained by the artificial intelligence. The user integration module 406 may be configured to execute the function, the function may include ordering food, booking a ride, booking movie tickets, booking train, booking bus tickets, and ordering products from third party applications 306, 308, 310 over the APIs ( Application programming interfaces).
[0048] Referring to FIG. 5 is a flowchart depicting an exemplary method for voice-activated function execution, in accordance with one or more exemplary embodiments. The method 500 may be carried out in the context of the details of FIG. 1, FIG. 2, FIG. 3, and FIG. 4. However, the method 500 may also be carried out in any desired environment. Further, the aforementioned definitions may equally apply to the description below.
[0049] The exemplary method 500 commences at step 502, enabling the user to interact with the computing device using the natural language voice commands by the communication module. Thereafter, at step 504, sending the natural language voice commands to the server from the computing device by the communication module over the network. Thereafter, at step 506, receiving the natural language voice commands by the user integration module enabled in the server. Thereafter, at step 508, processing the natural language voice commands by the user integration module using the natural language processing technique. Thereafter, at step 510, interpreting the processed natural language voice commands by the user integration module using speech recognition techniques and conversational platforms. Thereafter, at step 512, executing the function from one or more third party applications by the user integration module over the application programming interfaces (APIs) based on natural language voice commands. Thereafter, at step 514, sending the appropriate response to the computing device from the user integration module over the network.
[0050] Referring to FIG. 6 is a block diagram 600 illustrating the details of a digital processing system 600 in which various aspects of the present disclosure are operative by execution of appropriate software instructions. The Digital processing system 600 may correspond to the computing devices (or any other system in which the various features disclosed above can be implemented).
[0051] Digital processing system 600 may contain one or more processors such as a central processing unit (CPU) 610, random access memory (RAM) 620, secondary memory 630, graphics controller 660, display unit 670, network interface 680, and input interface 690. All the components except display unit 670 may communicate with each other over communication path 650, which may contain several buses as is well known in the relevant arts. The components of Figure 6 are described below in further detail.
[0052] CPU 610 may execute instructions stored in RAM 620 to provide several features of the present disclosure. CPU 610 may contain multiple processing units, with each processing unit potentially being designed for a specific task. Alternatively, CPU 610 may contain only a single general-purpose processing unit.
[0053] RAM 620 may receive instructions from secondary memory 630 using communication path 650. RAM 620 is shown currently containing software instructions, such as those used in threads and stacks, constituting shared environment 625 and / or user programs 626. Shared environment 625 includes operating systems, device drivers, virtual machines, etc., which provide a (common) run time environment for execution of user programs 626.
[0054] Graphics controller 660 generates display signals (e.g., in RGB format) to display unit 670 based on data / instructions received from CPU 410. Display unit 670 contains a display screen to display the images defined by the display signals. Input interface 690 may correspond to a keyboard and a pointing device (e.g., touch-pad, mouse) and may be used to provide inputs. Network interface 680 provides connectivity to a network (e.g., using Internet Protocol), and may be used to communicate with other systems (such as those shown in Figure 1) connected to the network 104.
[0055] Secondary memory 630 may contain hard drive 635, memory 636, and removable storage drive 637. Secondary memory 630 may store the data software instructions (e.g., for performing the actions noted above with respect to the Figures), which enable digital processing system 600 to provide several features in accordance with the present disclosure.
[0056] Some or all of the data and instructions may be provided on removable storage unit 640, and the data and instructions may be read and provided by removable storage drive 637 to CPU 610. Floppy drive, magnetic tape drive, CD-ROM drive, DVD Drive, memory, removable memory chip (PCMCIA Card, EEPROM) are examples of such removable storage drive 637.
[0057] Removable storage unit 640 may be implemented using medium and storage format compatible with removable storage drive 637 such that removable storage drive 437 can read the data and instructions. Thus, removable storage unit 640 includes a computer readable (storage) medium having stored therein computer software and / or data. However, the computer (or machine, in general) readable medium can be in other forms (e.g., nonremovable, random access, etc.)
[0058] In this document, the term "computer program product" is used to generally refer to removable storage unit 640 or hard disk installed in hard drive 635. These computer program products are means for providing software to digital processing system 600. CPU 610 may retrieve the software instructions, and execute the instructions to provide various features of the present disclosure described above.
[0059] The term “storage media / medium” as used herein refers to any non-transitory media that store data and / or instructions that cause a machine to operate in a specific fashion. Such storage media may comprise non-volatile media and / or volatile media. Non-volatile media includes, for example, optical disks, magnetic disks, or solid-state drives, such as storage memory 630. Volatile media includes dynamic memory, such as RAM 620. Common forms of storage media include, for example, a floppy disk, a flexible disk, hard disk, solid-state drive, magnetic tape, or any other magnetic data storage medium, a CD-ROM, any other optical data storage medium, any physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, NVRAM, any other memory chip or cartridge.
[0060] Storage media is distinct from but may be used in conjunction with transmission media. Transmission media participates in transferring information between storage media. For example, transmission media includes coaxial cables, copper wire and fibre optics, including the wires that comprise bus (communication path) 650. Transmission media canalso take the form of acoustic or light waves, such as those generated during radio-wave and infra-red data communications.
[0061] Reference throughout this specification to “one embodiment”, “an embodiment”, or similar language means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present disclosure. Thus, appearances of the phrases “in one embodiment”, “in an embodiment” and similar language throughout this specification may, but do not necessarily, all refer to the same embodiment.
[0062] Although the present disclosure has been described in terms of certain preferred embodiments and illustrations thereof, other embodiments and modifications to preferred embodiments may be possible that are within the principles of the invention. The above descriptions and figures are therefore to be regarded as illustrative and not restrictive.
[0063] Thus the scope of the present disclosure is defined by the appended claims and includes both combinations and sub-combinations of the various features described hereinabove as well as variations and modifications thereof, which would occur to persons skilled in the art upon reading the foregoing description.
Claims
CLAIMSWe Claim1. A system for voice-activated function execution, comprising: a computing device comprises a communication module, wherein the communication module configured to enable a user to interact with the computing device using natural language voice commands to execute one or more functions, whereby the communication module sends the natural language voice commands to a server over a network; and the server comprises a user integration module configured to receive the natural language voice commands from the communication module, wherein the user integration module configured to process and interpret the user natural language voice commands using speech recognition, natural language processing technologies, and one or more conversational platforms, whereby the user integration module interacts with one or more third-party applications through the one or more third-party applications programming interfaces (APIs) and executes the one or more functions based on the interpreted user natural language voice commands.
2. The system as claimed in claim 1, wherein the communication module comprises a voice recording module is configured to enable the user to interact with the computing device using the natural language voice commands to execute the one or more functions.
3. The system as claimed in claim 1, wherein the communication module comprises a video recording module is configured to enable the user to capture one or more images and videos on the computing device.
4. The system as claimed in claim 2, wherein the voice recording module is configured to send the natural language voice commands to the server over the network.
5. The system as claimed in claim 1, wherein the user integration module is configured to receive the natural language voice commands from the voice recording module.
6. The system as claimed in claim 1, wherein the user integration module comprises a speech processing module is configured to process the natural language voice commands using natural language processing technologies.
7. The system as claimed in claim 1, wherein the user integration module comprises a speech recognition module is configured to interpret the natural language voice commands using speech recognition technologies and conversational platforms.
8. The system as claimed in claim 1, wherein the user integration module comprises a bookings and orders placing module is configured to execute one or more functions from the one or more third party applications based on the interpreted natural language voice commands.
9. The system as claimed in claim 1, wherein the user integration module utilizes artificial intelligence techniques to interpret and execute the natural language voice commands.
10. A method for voice -activated function execution, comprising: enabling a user to interact with a computing device using natural language voice commands by a communication module; sending the natural language voice commands to a server from the computing device by the communication module over a network; receiving the natural language voice commands by a user integration module enabled in the server; processing the natural language voice commands by the user integration module using natural language processing techniques; interpreting the processed natural language voice commands by the user integration module using speech recognition techniques and conversational platforms;executing one or more functions from one or more third party applications by the user integration module through application programming interfaces (APIs) based on the interpreted natural language voice commands; and sending an appropriate response to the computing device from the user integration module over the network.
Citation Information
Patent Citations
Method and system for interacting with third-party application
US20200005771A1
Voice-based operations
US20200320991A1
