An autonomous mobile robotic system and method for store operations and customer engagement
The autonomous mobile robotic system addresses the challenge of integrating navigation, object manipulation, and customer interaction by using an autonomous mobile unit, robotic manipulator, and central controller, achieving efficient and safe navigation and task execution while enhancing customer engagement.
Patent Information
- Application Number
- PCT/IN2024/052164
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-10-31
- Filing Date
- 2024-10-29
- Publication Date
- 2025-05-08
AI Technical Summary
Existing autonomous mobile robotic systems struggle to seamlessly integrate navigation, object manipulation, and customer interaction within complex retail environments, often requiring trade-offs between task efficiency and social interaction.
An autonomous mobile robotic system comprising an autonomous mobile robotic unit with advanced navigation sensors, a robotic manipulator with versatile gripping capabilities, and a central controller for coordinated task execution, along with features like interchangeable grippers, computer vision, and in-store edge devices for enhanced customer detection and data management.
The system achieves efficient and safe navigation, precise task execution, and improved customer engagement, resulting in increased operational efficiency, enhanced user experience, and optimized store operations.
Smart Images

Figure IN2024052164_08052025_PF_FP_ABST
Abstract
Description
AN AUTONOMOUS MOBILE ROBOTIC SYSTEM AND METHOD FOR STORE OPERATIONS AND CUSTOMER ENGAGEMENT
[0001] The field of invention generally relates to robots. More specifically, it relates to an autonomous mobile robotic system and method for store operations and customer engagement.
[0002] The landscape of technology has seen remarkable growth in recent years, bringing forth innovations that redefine the way we interact with our environment. Among these advancements, autonomous mobile robotic systems have emerged as a transformative force, seamlessly integrating mobility, perception, and interaction to execute tasks across various domains. These systems combine cutting-edge hardware, sophisticated sensors, and intelligent algorithms to navigate complex environments and collaborate with humans. Their potential spans industries such as retail, manufacturing, healthcare, and more, revolutionizing the way tasks are accomplished and processes are optimized.
[0003] Currently, existing systems do not succeed in fully harnessing the potential of autonomous robotics within complex environments. These environments, often characterized by dynamic interactions and intricate tasks, require a level of adaptability and coordination that conventional solutions struggle to provide. The
[0004] need for a comprehensive autonomous mobile robotic system that can seamlessly traverse spaces, manipulate objects, and engage with users has become increasingly evident.
[0005] Other existing systems have tried to address this problem. However, their scope was limited to focusing on singular functionalities. There are two main types
[0006] of robots: one group is good at tasks like manufacturing and moving things, and the other is designed to interact with people for things like helping. As technology improved, both types of robots got better, but a big problem still remains: robots that are good at tasks usually don't interact well with people, and robots that are good at talking and interacting often can't do complex tasks
[0007] Thus, in light of the above discussion, it is implied that there is need for an autonomous mobile robotic system and method for store operations and customer engagement which is reliable and does not suffer from the problems discussed above.Object of Invention
[0008] The principal object of this invention is to provide an autonomous mobile robotic system and method for store operations and customer engagement.
[0009] The objective of the invention is to create an autonomous mobile robotic system that bridges the gap between working robots, focused on efficient manufacturing and logistics tasks, and social robots, excelling in human interaction for services, companionship, and education.
[0010] Another object of the invention is to provide an autonomous mobile robotic unit that smoothly navigates within the store area, improving the overall operational effectiveness.
[0011] Another object of the invention is to provide a flexible multi degree of freedom robotic manipulator that performs user-assigned tasks, enhancing the system's versatility and adaptability.
[0012] Another object of the invention is to develop a central controller situated within the autonomous robotic unit for seamless task coordination and execution with at least one of the robotic manipulator and the autonomous robotic unit, wherein the autonomous mobile base robotic unit and the robotic manipulator comprise at least one sub-controller configured to execute one or more tasks communicated by the central controller.
[0013] Another object of the invention is to provide interchangeable grippers for the robotic manipulator, and quick adaptability for various tasks
[0014] Another object of the invention is to integrate cameras for barcode reading and customer identification, improving interaction and functionality
[0015] Another object of the invention is to incorporate in-store edge devices (cameras and a server) for enhanced customer detection and data management.
[0016] Another object of the invention is to ensure that the system provides coordinated task execution, efficient and safe navigation, and user-friendly interaction in a retail environment
[0017] Another object of the invention is to ensure that the autonomous mobile robotic system offers advantages such as increased operational efficiency, versatile task execution, seamless coordination, and improved user experience, making it a valuable addition to store operations
[0018] This invention is illustrated in the accompanying drawings, throughout which, like reference letters indicate corresponding parts in the various figures.
[0019] The embodiments herein will be better understood from the following description with reference to the drawings, in which:Fig. 1
[0020] depicts / illustrates an autonomous mobile robotic system, in accordance with an embodiment;Fig. 2
[0021] depicts / illustrates a schematic representation of the components comprising the autonomous mobile robotic system and their interconnections, in accordance with an embodiment;Fig. 3
[0022] depicts / illustrates a front view of the autonomous mobile robotic system, in accordance with an embodiment;Fig. 4
[0023] depicts / illustrates a side view of the autonomous mobile robotic system, in accordance with an embodiment;Fig. 5
[0024] depicts / illustrates a rear view of the autonomous mobile robotic system, in accordance with an embodiment;Fig. 6a
[0025] depicts / illustrates a structure of the autonomous mobile robotic system, in accordance with an embodiment;Fig. 6b
[0026] depicts / illustrates an outer body of the autonomous mobile robotic system, in accordance with an embodiment;Fig. 7
[0027] illustrates a method for an autonomous mobile robotic system, in accordance with an embodiment.Statement of Invention
[0028] The present invention discloses an autonomous mobile robotic system and
[0029] method for store operations and customer engagement. The system comprises an
[0030] autonomous mobile robotic unit (AMR) capable of navigating through store areas
[0031] with precision, alongside a robotic manipulator seamlessly integrated at the back of
[0032] the autonomous mobile robotic unit. This robotic manipulator is configured to
[0033] execute tasks assigned by users for various operational requirements
[0034] A central controller is embedded within the autonomous mobile robot unit, the central controller establishes a connection by receiving user instructions and transmitting command instructions to efficiently coordinate the operations of both the autonomous mobile robotic unit and the robotic manipulator. The system incorporates features, comprising a navigation unit equipped with LIDAR sensors, ultrasonic sensors, depth sensors, IR sensors and visual cameras ensuring accurate movement and effective obstacle avoidance.
[0035] The robotic manipulator encompasses a gripping unit adept at precise object manipulation, complemented by an interchangeable unit for quick gripper swapping. A computer vision unit, featuring a camera and an AI powered processor, further enhances the system's capabilities by capturing visual data and enabling it during task execution. With features like real-time feedback through sub controllers, interactive display screens, audio devices, sensing devices and customer-centric functionalities, the autonomous mobile robotic system redefines store operations, promising heightened efficiency, improved customer service, and an enhanced work environment.Detailed Description
[0036] The embodiments herein and the various features and advantageous details thereof are explained more fully with reference to the non-limiting embodiments that are illustrated in the accompanying drawings and / or detailed in the following description. Descriptions of well-known components and processing techniques are omitted so as to not unnecessarily obscure the embodiments herein. The examples used herein are intended merely to facilitate an understanding of ways in which the embodiments herein may be practiced and to further enable those of skill in the art to practice the embodiments herein. Accordingly, the examples should not be construed as limiting the scope of the embodiments herein.
[0037] The present invention discloses an autonomous mobile robotic system and method for store operations and customer engagement. The system comprises a autonomous mobile robotic unit equipped with a navigation unit, seamlessly integrated with a robotic manipulator for versatile task execution. A central controller is embedded within the autonomous mobile robotic unit, enabling seamless communication and coordinated operation of the autonomous mobile robotic unit and the robotic arm by communication to its sub system (sub controller). The system incorporates features, comprising at least one comprehensive sensor array, flexible gripper units, and advanced computer vision, all contributing to precise and efficient task execution. The invention enhanced operational efficiency, improved customer engagement, and a futuristic approach to optimizing store processes.
[0038] depicts / illustrates a system 100 comprising an autonomous mobile robotic unit 102, a robotic manipulator 104 and a central controller 106.
[0039] The autonomous mobile robotic unit 102 facilitates smooth movement within a specified store region. The autonomous mobile robotic unit 102 can easily navigate intricate surroundings, thereby increasing its effectiveness in dynamic retail environments.
[0040] The robotic manipulator 104 is configured to perform user-assigned tasks with its versatile gripping unit and advanced computer vision capabilities.
[0041] The central controller 106 orchestrates seamless coordination between the autonomous mobile robotic unit 102 and the robotic manipulator 104 through its sub controller, ensuring efficient task execution and user interaction.
[0042] depicts / illustrates a schematic representation of the components comprising the autonomous mobile robotic system 100 and their interconnections, in accordance with an embodiment.
[0043] In an embodiment, the autonomous mobile robotic unit 102 facilitates smooth maneuvering within a predetermined store region. The autonomous mobile robotic unit 102 is equipped with a navigation unit 112 that comprises at least one of LIDAR, ultrasonic sensors, and visual cameras, sensors to accurately measure distances and create three-dimensional representations of the surroundings. These measurements are then communicated to a motion unit, which is responsible for executing the commands issued by the navigation unit 112.
[0044] In an embodiment, the motion unit ensures precise physical movement of the system 100 in response to user instructions. Additionally, a battery unit powers the entire operation of the system 100, ensuring uninterrupted functionality.
[0045] The robotic manipulator 104, is designed to perform an array of tasks assigned by users. The robotic manipulator 104 comprises a gripping unit 114 used for gripping objects. and facilitating precise object manipulation.
[0046] An interchangeable unit, attached to the gripping unit 114, offers swift gripper interchangeability, thus enhancing versatility. The interchangeable unit can be used to attach to one or more grippers comprising at least one of vacuum gripper, mechanical grippers, and soft grippers.
[0047] A computer vision unit captures and communicates visual data, the system 100 to analyze its surroundings for enhanced object identification and interaction during task execution.
[0048] The computer vision unit comprises a camera 116 and an AI powered processor 118. The camera 116 and the AI powered processor 118 combinations of hardware and software enable the system to process visual data in real-time and engage in interactive communication with the central controller 106. The camera 116, serves as the sensory input device. The camera 116 captures visual information from its surroundings of the system 100, which may comprise objects, racks, and customers within the store area. This visual data is then transmitted to the AI powered processor 118. The AI powered processor 118, is equipped with advanced algorithms and processing capabilities.
[0049] The AI powered processor 118 analyzes the visual data received from the camera 116 using its algorithms. It can identify objects, assess their positions, and recognize patterns within the environment.
[0050] The processed data and insights generated by the AI powered processor are shared with the central controller 106. This communication enables the system to interact with the central controller 106 in real time, providing updates on the environment's status and ongoing tasks. The central controller 106 can make prompt and accurate decisions, adjusting the system's actions according to the visual information received.
[0051] In The central controller 106 is configured to coordinate with at least one ofthe autonomous mobile robotic unit 102 and the robotic manipulator 104. The central controller 106 comprises one or more sub-controllers 132a and 132b within both the navigation unit 112 and the robotic manipulator 104. The sub-controllers132a and 132b execute tasks, offer guidance to at least one of the autonomous mobile robotic unit 102 and the robotic manipulator 104, and enhance the system's overall efficiency. The sub-controllers 132a and 132b are like small brains within the larger system, responsible for specific tasks and coordination. The Sub-controller 132a is dedicated to managing tasks related to the autonomous mobile robotic unit 102, which is the part of the system 100 that is responsible for moving around. The Sub-controller 132a guides the navigation, obstacle avoidance, and overall movement within its designated area, ensuring that the system 100 moves safely and efficiently.
[0052] The sub-controller 132b focuses on the robotic manipulator 104 of the robot that performs tasks like picking up objects or interacting with its environment. The sub-controller 132b controls the robotic manipulator 104 at least one of robotic manipulator movements, gripping mechanism, and interaction with objects. It ensures that the robotic manipulator 104 moves precisely and accurately to complete the tasks assigned to it.
[0053] A display screen facilitates interaction between users and the system in the store area. A camera 118, integrated with the display screen, facilitates barcode reading and customer identification within the store area, contributing to efficient store operations.
[0054] A communication unit 120 serves as the bridge between the system 100 components, facilitating seamless interaction between the central controller 106 and the sub-controllers 132a and 132b. This real-time data feedback mechanism ensures the effective execution of tasks and enhances coordination within the store area.
[0055] The autonomous mobile robotic system 100 incorporates at least one in-store security camera unit 128 positioned within the store environment to capture and record visual data of various activities and events taking place in the store. The purpose of this in-store security camera unit 128 goes beyond mere surveillance it serves as a valuable source of information that contributes to the overall efficiency and functionality of the system 100..
[0056] The recorded data collected by the in-store security camera unit 128 data is sent to two key destinations to fulfil specific functions. One destination is a dedicated server 122, designed to serve as a centralized repository for storing and managing a wide range of data. The server 122 a crucial role in the system's ability to retain and organize information over time. Additionally, the recorded data is transmitted to the central controller 106 of the autonomous mobile robotic system 100.
[0057] The central controller 106 actively processes the data received from the in-store security camera unit 128, engaging in intricate analysis and pattern recognition. By studying the recorded store area data, the central controller 106 gains insights into the movements, behaviors, and interactions of customers within the store.
[0058] The central controller's 106 data analysis is its ability to discern the presence of customers within the store. This capability to detect and identify customers is a direct result of the recorded store area data being meticulously analyzed. The system 100 offers features comprised of assisting customers, offering product recommendations, and ensuring efficient navigation. The system's responsiveness is significantly enhanced by this customer detection mechanism.
[0059] The integration of the in-store security camera unit 128 and its seamless connection to both the server 122 and the central controller 106 underscores the system's commitment to streamlined store operations. By leveraging the power of recorded data, the system 100 not only gains valuable insights into customer behavior but also optimizes its overall functioning. This results in improved customer engagement, efficient navigation, and better coordination among the system's various components, all contributing to an enhanced store experience for both customers and operators alike.
[0060] depicts / illustrates a front view of the autonomous mobile robotic system, in accordance with an embodiment.
[0061] In the embodiment, the autonomous mobile robotic unit 102 is equipped with advanced components like 3D LiDAR and Intel Realsense D415 cameras. These components work together to generate laser scan data, which is skillfully utilized for tasks such as mapping, localization, and obstacle avoidance. This synergy between the sophisticated sensors provides precise insights, enabling the system to perform intricate tasks with accuracy.
[0062] The 3D LiDAR and Intel Realsense D415 cameras employed in the autonomous mobile robotic unit 102 offer a holistic perception of the surroundings. The 3D LiDAR generates a detailed point cloud map of the environment, enabling the system to navigate even in low-light conditions. The Intel Realsense D415 cameras provide RGB and depth data that contribute to accurate object recognition and depth estimation.
[0063] In an embodiment, the battery unit uses a rechargeable LiPo battery rated at 48 VDC with a formidable capacity of 60 amp-hours. To cater to the diverse voltage requirements of various components, DC-DC converters are employed. A noteworthy feature is the incorporation of a 48V to 48V DC–DC converter, which shields the robotic manipulator system from potential power fluctuations that could compromise its performance. The power distribution is carefully managed, comprising the use of a 48V to 12V DC-DC converter via a block terminal. This allocation powers essential components such as cooling fans, an Ethernet switch, and a 12V to 5V DC–DC converter. The latter provides power to a Jetson Xavier NX through a dedicated DC jack connector. The system's internal circuitry is designed with user-friendliness in mind, featuring connectors that facilitate easy plug-and-play interfaces.
[0064] The Jetson Xavier NX, serving as the AI powered processor, represents a significant leap in computational capabilities. Its GPU-accelerated processing capabilities enable complex tasks such as object recognition and trajectory planning to be executed swiftly, contributing to the system's agility and responsiveness.
[0065] The use of the rechargeable LiPo battery for the battery unit is a result of a deliberate choice to balance power capacity with weight considerations. The battery's high capacity ensures extended operational periods, reducing the frequency of recharging. Additionally, the integration of safety mechanisms, such as the miniature circuit breaker (MCB), safeguards the battery and connected components from potential electrical issues.
[0066] depicts / illustrates a side view of the autonomous mobile robotic system, in accordance with an embodiment.
[0067] In an embodiment, the central controller 106 effectively uses a laptop for data processing and user interaction. Additionally, the AI powered processoremploys the Jetson Xavier NX to enhance the system's capabilities. The camera setup comprises of Intel Realsense D415 cameras, which play a pivotal role in capturing visual data for analysis and decision-making.
[0068] The central controller 106 is not only a hub for data processing but also serves as an interactive interface for users and operators. Its compact form factor and integrated screen make it an efficient command center for orchestrating the system's tasks and responding to user inputs in real-time.
[0069] In an embodiment, the AI powered processor uses the jetson Xavier NX to orchestrate the requisite actions, elevating system 100's capabilities. The camera 116 and camera 118 used is Intel Realsense D415 cameras.
[0070] The autonomous mobile robotic system 100 adaptability and responsiveness stem from the intricate communication network that connects the various components. The interplay between the laptop-based central controller 106, the Jetson Xavier NX, in-store security camera unit 128, and other sub-controllers (132a and 132b) establishes a seamless data exchange system, enabling quick decision-making and efficient task execution.
[0071] The integration of the in-store security camera unit 128 reflects the system's commitment to not only function as a robotic assistant but also to contribute to the store's overall security and operational efficiency. This integration demonstrates the system's versatility in serving multiple roles within the store environment.
[0072] The system 100 careful consideration of power distribution and connectivity ensures that each component receives the appropriate voltage, minimizing energy wastage and optimizing efficiency. The use of Anderson connectors, DC barrel jacks, DC jack males, and aviation connectors simplifies maintenance and facilitates swift replacements when necessary.
[0073] depicts / illustrates a rare view of the autonomous mobile robotic system, in accordance with an embodiment.
[0074] A cooling fan 124 is integrated into the robotic system 100 to ensure optimal operating temperatures and actively dissipate the heat generated during the robot's operations. By effectively expelling excess heat, the cooling fan 124 maintains the system's temperature within an ideal range, thereby safeguarding its performance, durability, and reliability.
[0075] The cooling fan 124 strategic placement and efficient operation help maintain an optimal internal temperature within the robotic system 100. This temperature regulation not only prevents overheating but also extends the lifespan of sensitive electronic components. The cooling fan 124 noise level is engineered to be unobtrusive, ensuring that the system's presence in the store area doesn't disrupt the overall ambience.
[0076] depicts / illustrates a structure of the autonomous mobile robotic system 100, in accordance with an embodiment.
[0077] The autonomous mobile robotic system 100 comprises a structural frame 126 which acts as a sturdy backbone, providing essential support to the various integrated components and mechanisms within the robotic system 100. This robust structural framework ensures stability and resilience, enabling the robotic system 100 to navigate different environments with confidence.
[0078] To ensure optimal structural integrity, one or more angular support frames have been strategically incorporated on each side of the primary structural frame 126. This design innovation serves to evenly distribute payload concentration across the entirety of the structure. The selection of the final frame 126 configuration was meticulously guided by a comprehensive static stress analysis conducted on multiple iterations. The chosen support frame is the outcome of a dual evaluation encompassing displacement and safety factors.
[0079] The robustness of the support frame is underpinned by rigorous load testing, involving both 35 kg and 25 kg hanging loads applied downward and at opposing sides. This meticulous assessment has determined that a current support frame boasts a remarkable load-bearing capacity of up to 150 kg, effectively catering to diverse operational requirements. Additionally, the frame's inherent capability to disperse vibrations generated during the robotic manipulator operation further underscores its reliability.
[0080] A distinct advantage of this frame 126 lies in its flexibility. Devoid of permanent joints, it stands primed for customization in response to evolving needs. This adaptability ensures that modifications can be swiftly integrated whenever necessitated by specific operational demands.
[0081] The structural frame 126 is meticulously designed to withstand dynamic forces and vibrations that the robotic system 100 may encounter during its operation. The selection of materials and engineering principles ensures that the structural frame 126 not only provides support but also contributes to the overall stability and durability of the robotic system 100. This robust foundation enhances the system's capability to navigate challenging terrains and environments with agility.
[0082] depicts / illustrates an outer body of the autonomous mobile robotic system 100, in accordance with an embodiment..
[0083] The outer body 130 of the autonomous mobile robotic system 100 is designed with inspiration from the human form, combining aesthetics and functionality. This humanoid-inspired outer body 130 is carefully crafted to maintain structural integrity during all forms of motion. It achieves a harmonious balance between appearance and practicality. Guided by the principle of minimalism, the outer body 130 features streamlined contours and surfaces that are optimized to withstand the dynamic demands of operation. This design philosophy emphasizes simplicity and efficiency, resulting in an outer body 130 that is easy to assemble and maintain. To achieve this, we've reduced the number of parts and made disassembly and reassembly quick and straightforward. Instead of using numerous separate screws and bolts, we've employed special joints that easily snap or slide into place. This approach not only accelerates construction and repair processes but also enhances the overall structural integrity of the robot.
[0084] The outer body 130, beyond its functional significance, also plays a crucial role in creating a welcoming and non-threatening appearance. The humanoid-inspired design of the outer body 130 is intended to evoke a sense of familiarity and approachability for users and customers interacting with the robotic system 100. This aspect contributes to the overall user experience, fostering positive interactions and engagements.
[0085] The strategic use of snap-fit joints and sliding-fit joints for assembly and maintenance highlights the system's user-centric design. By simplifying the construction and repair processes, the robotic system 100 ensures that the robotic system 100 can be promptly returned to operational status, reducing downtime and optimizing its availability for tasks.
[0086] The outer body 130 of the system 100 is constructed using ABS (Acrylonitrile Butadiene Styrene), a cost-effective thermoplastic material, through the 3D printing process. The utilization of ABS plastic for the outer body is a judicious choice, attributed to its inherent durability and resistance to cracking, even under stress. This robustness is further fortified by the structural support provided by the frame 126, which predominantly absorbs the mechanical load.
[0087] Incorporating foresight into the design, the dimensions of the outer body 130 were meticulously planned to accommodate potential future components. The deliberate provision of ample clearance ensures that any future expansions or enhancements can be seamlessly integrated without spatial constraints.
[0088] Post-fabrication, when considering the combined weight of the structure and the frame 126, the aggregate weight approximates 46 kilograms. This metric, however, encompasses solely the structural aspects. The entire structure must possess the capacity to effectively support a payload exceeding 100 kilograms. This requirement underscores the robustness and load-bearing capability expected from the chosen mobile robot.
[0089] illustrates a method 700 for an autonomous mobile robotic system. The method begins with navigating in a store area, by using an autonomous mobile robotic unit, as depicted at step 702. Subsequently, the method 700 discloses performing tasks assigned by a user by using a robotic manipulator, wherein the robotic manipulator is connected to the autonomous mobile robotic unit, as depicted at step 704. Thereafter, the method 700 discloses receiving one or more user instructions and sending one or more command instructions for operation and coordinated task execution to at least one of the autonomous mobile robotic unit and the robotic manipulator, by using a central controller, wherein the central controller is connected to the autonomous mobile robotic unit, as depicted at step 706.
[0090] The advantages of the current invention include:
[0091] Seamless Navigation: The system's autonomous mobile robotic unit is equipped with advanced navigation units, comprising LIDAR, ultrasonic sensors, and visual cameras, which enable smooth maneuvering within designated store areas.
[0092] Versatile Task Execution: The robotic manipulator's versatile gripping unit and advanced computer vision capabilities to perform a wide range of user-assigned tasks with precision and efficiency.
[0093] Efficient Coordination: The central controller orchestrates seamless coordination between the autonomous mobile robotic unit and robotic manipulator, ensuring optimal task execution and user interaction.
[0094] Real-time Visual Analysis: The AI powered processor, combined with Intel Realsense D415 cameras, facilitates real-time visual data processing, empowering the system to make informed decisions based on the environment's context.
[0095] Enhanced Object Manipulation: The gripping unit, comprising vacuum grippers, mechanical grippers, and soft grippers, ensures precise object manipulation, enhancing the system's utility in various scenarios.
[0096] The User Interaction: A user-friendly display screen on the central controller for interactive communication with users, offering features like barcode reading and customer identification for efficient store operations.
[0097] Customer Detection and Engagement: The system's ability to discern and identify customers through data analysis supports features such as customer assistance, product recommendations, and efficient navigation.
[0098] Data-Driven Decision Making: Integration with in-store security camera units provides valuable insights into customer behavior, contributing to optimized store operations, enhanced customer engagement, and efficient navigation.
[0099] Optimized Power Distribution: The system employs DC-DC converters and careful power allocation, ensuring each component receives the appropriate voltage, minimizing energy wastage, and enhancing overall efficiency.
[0100] Streamlined Maintenance: Snap-fit joints and sliding-fit joints simplify assembly and disassembly, reducing the number of parts and minimizing downtime for maintenance and repairs
[0101] Advanced Sensor Integration: Integration of 3D LiDAR and Intel Realsense D415 cameras on the autonomous mobile robotic unit provides accurate laser scan data for mapping, localization, and obstacle avoidance, enhancing navigation capabilities
[0102] Enhanced AI Processing: The Jetson Xavier NX AI powered process or processes complex tasks like object recognition and trajectory planning swiftly, contributing to the system's agility and responsiveness.
[0103] Structural Integrity: The structural frame and outer body design ensure stability and durability, the system to navigate various environments with resilience
[0104] User-Centric Design: The humanoid-inspired outer body design not only maintains structural integrity but also fosters positive user interactions and engagements
[0105] Optimal Thermal Management: The integrated cooling fan regulates internal temperatures, preventing overheating, extending component lifespan, and maintaining system performance
[0106] Enhanced Efficiency: The interconnected communication network between components facilitates quick decision-making and efficient task execution
[0107] Data-Driven Optimization: Utilizing recorded data from in-store security cameras optimizes overall system functioning, improving customer engagement, navigation, and coordination among components
[0108] Applications of the current invention include:
[0109] Retail Stores:
[0110] Assist customers with locating products within the store, Offer product recommendations based on customer preferences, Provide information about ongoing promotions and discounts, Enable efficient restocking and inventory management.
[0111] Warehouses and Distribution Centers:
[0112] Streamline inventory management by navigating and retrieving items, Assist in packing and sorting orders for shipment, Perform routine inventory checks and update stock levels
[0113] Hospital Environments:
[0114] Deliver medical supplies and equipment to different departments, Transport patient records and specimens securely and efficiently, Assist healthcare professionals in locating and retrieving items.
[0115] Hospitality Industry:
[0116] Deliver room service orders to hotel guests, Transport luggage to guest rooms, Provide information about hotel amenities and services.
[0117] Manufacturing Facilities:
[0118] Assist in material handling and transferring components, Transport finished products to designated areas, Support quality control processes by moving items for inspection.
[0119] Office Environments:
[0120] Distribute documents and office supplies to various departments, Assist with mail and package delivery within the office, Provide a mobile platform for video conferencing and communication.
[0121] Educational Institutions:
[0122] Transport classroom materials and equipment between classrooms, Support remote learning by delivering educational resources, Assist with campus tours and events.
[0123] Airports:
[0124] Transport luggage between check-in counters, baggage claim, and gates, Provide information to passengers about flight gates and schedules, Assist airport personnel in various tasks, such as cleaning and maintenance.
[0125] Smart Homes:
[0126] Act as a personal assistant by fetching items and performing simple tasks, Provide security monitoring by patrolling designated areas, Enable remote communication and control through a user-friendly interface.
[0127] Logistics and E-commerce:
[0128] Aid in sorting and packaging items in distribution centres, Support last-mile delivery for e-commerce orders, Enhance warehouse efficiency by navigating through storage areas.
[0129] Public Spaces and Events:
[0130] Provide information and guidance to visitors during exhibitions or Events, Assist in crowd management and security monitoring, Offer interactive entertainment and engagement for attendees.
[0131] Agriculture and Farming:
[0132] Assist in crop monitoring and data collection, Transport harvested crops from the field to storage areas, Support automated irrigation and fertilization processes.
[0133] The foregoing description of the specific embodiments will so fully reveal the general nature of the embodiments herein that others can, by applying current knowledge, readily modify and / or adapt for various applications such specific embodiments without departing from the generic concept, and, therefore, such adaptations and modifications should and are intended to be comprehended within the meaning and range of equivalents of the disclosed embodiments. It is to be understood that the phraseology or terminology employed herein is for the purpose of description and not of limitation. Therefore, while the embodiments herein have been described in terms of preferred embodiments, those skilled in the art will recognize that the embodiments herein can be practiced with modification within the scope of the embodiments as described here.
Claims
An autonomous mobile robotic system (100), comprising:an autonomous mobile robotic unit (102) configured to navigate in a storearea;a robotic manipulator (104) connected to the autonomous mobile roboticunit (102), configured to perform tasks assigned by a user; anda central controller (106) comprised within the autonomous mobile roboticunit (102), configured to receive one or more user instructions and send oneor more command instructions for operation and coordinated task executionto at one least of the autonomous mobile robotic unit (102) and the roboticmanipulator (104).The system (100) as claimed in claim 1, wherein the autonomous mobile robotic unit (102) comprises:a navigation unit (112) configured to navigate within the store by measuringdistances, creating three-dimensional representations and communicatingexecute commands to a motion unit;the motion unit configured to execute commands received by a navigationunit (112) and control one or more physical movements of the system (100)in response to user instructions; anda battery unit configured to supply power for operations of the system (100)The system (100) as claimed in claim 2, wherein the navigation unit (112) comprises at least one of LIDAR sensor, ultrasonic sensors, depth sensors,IR sensors and visual cameras.The system (100) as claimed in claim 1, wherein the robotic manipulator (104) comprises:a gripping unit (114) configured for precise gripping and manipulation ofone or more objects;an interchangeable unit, connected to an end of the gripping unit (114),configured for a quick interchange of one or more grippers; anda computer vision unit configured to capture one or more visual data,analyses surroundings of the autonomous mobile robotic unit (102) andfacilitate object identification and interaction during task execution.The system (100) as claimed in claim 4, wherein the grippers comprise at least one of vacuum gripper, mechanical gripper, and soft gripper.The system (100) as claimed in claim 4, wherein the computer vision unit comprises:a camera (116) connected to the robotic manipulator (104), configured tocapture one or more visual data from a rack; andan AI powered processor (118) configured to process the visual data andarm position, and communicate the visual data and arm position to thecentral controller (106).The system (100) as claimed in claim 1, wherein the central controller (106) comprises:at least one sub controller (132a and 132b) connected to at least one of thenavigation unit (112) and the robotic manipulator (104), wherein the at leastone sub controller (132) is configured to execute one or more taskscommunicated by the central controller (106) and provide guidance to atleast one of the navigation unit (112) and the robotic manipulator (104); anda display screen configured to interact with the user in the store area.The system (100) as claimed in claim 1, comprising at least one camera (118) connected to the display screen, configured for barcode reading and customer identification.The system (100) as claimed in claim 1, comprising a communication unit (120) configured to enable the central controller (106) to communicate with at least one sub controller.The system (100) as claimed in claim 1, comprising at least one in-store security camera unit (128) configured to record and communicate store area data to at least one of a server (122) and the central controller (106) through the communication unit (120), wherein the central controller (106) detects a customer by recorded store area data.A method (700) for an autonomous mobile robotic system, comprising:navigating in a store area, by using an autonomous mobile robotic unit (102);performing tasks assigned by a user by using a robotic manipulator (104),wherein the robotic manipulator (104) is connected to the autonomousmobile robotic unit (102); andreceiving one or more user instructions and sending one or more commandinstructions for operation and coordinated task execution to at least one ofthe autonomous mobile robotic unit (102) and the robotic manipulator (104),by using a central controller (106), wherein the central controller (106) isconnected to the autonomous mobile robotic unit (102).The method (700) as claimed in claim 11, comprising configuring the autonomous mobile robotic unit (102) for:navigating within the store by measuring distance and creating three-dimensional representations communicating execute commands to a motionunit, by a navigation unit (112);executing commands received by a navigation unit (112) control one ormore physical moments of the system in response to user instructions, by amotion unit; andsupplying power for operations of the system, by a battery.The method (700) as claimed in claim 11, comprisingconfiguring the robotic manipulator (104) for:gripping and manipulating one or more objects precisely, by using agripping unit (114);interchanging one or more grippers by using an interchangeable unit, wherein the interchangeable unit is connected to an end of the gripping unit (114); and capturing one or more visual data, analysing surroundings of the autonomous mobile robotic unit (102) and facilitating object identification and interaction during task execution, by using a computer vision unitThe method (700) as claimed in claim 13, comprising configuring the computer vision unit for:capturing one or more visual data of a rack, by using a camera (116), wherein the camera (116) is connected to the robotic manipulator (104); and processing and sending at least one of visual data, and arm position to thecentral controller (106) by using an AI powered processor (118).The method (700) as claimed in claim 11, comprising configuring the central controller (106) for:executing one or more tasks communicated by the central controller (106)and providing guidance to at least one of the navigation unit (112) and the robotic manipulator (104), by using at least one sub controller (132), wherein the at least one sub controller (132) is connected to at least one of the navigation unit (112) and the robotic manipulator (104); and interacting with the user in the store area, by using a display screenThe method (700) as claimed in claim 11, comprising configuring at least one camera (118) for barcode reading and customer identification wherein the at least one camera (118) is connected to the display screen.The method (700) as claimed in claim 11, comprising configuring a communication unit (120) for enabling the central controller (106) to connect with at least one sub controller for tasks, wherein the at least one sub controller provides real-time data feedback and receive tasks command instructions from the central controller (106).The method (700) as claimed in claim 11, comprising configuring at least one in-store security camera unit for recording and communicating store area data to at least one of a server (122) and the central controller (106) through the communication unit (120), wherein the central controller (106) detects the customer by recorded store area data.
Citation Information
Patent Citations
Intelligent cart robotic devices for use in stores and warehouses
KR1020180109107A
Autonomous robotic system for collecting products
WO2023092244A1