Intelligent robot for autonomous shopping and accompanying

Abstract

The invention relates to an intelligent robot for autonomous shopping and accompanying, comprising a robot (100) equipped with artificial intelligence (AI), connected to a human owner (111) by means of a peripheral device (115), the robot being powered by its electrical, solar or kinetic energy (108) stored in a battery (105). The robot is equipped with multitasking technology sensors for performing autonomous field tasks and operating or moving with a human companion (103) while carrying items (110) in their hands and in the basket (102). The robot is equipped with an interactive display screen (101) including a technical media input / output module and a short-range and remote communication (SRC-LRC) transceiver module connected to an identity recognition reading device (IRD) (112) with an electronic payment function and equipped with an image output device for outputting an image of an item to be purchased to assist a buyer in recognizing the item (113). The robot uses a camera (106) to identify objects and items and transmits information to a unit (109) for electronized processing and storage of perceptual information and data for subsequent use in autonomous or accompanying movement via the communication technology of a wireless geospatial navigation system (GPS-GNS). The robot may converse with the buyer through a natural language input / output processing module (104). The robot is also equipped with an augmented reality / virtual reality / mixed reality (AR-VR-MR) device (107) to help it learn to simulate a new environment in an unidentified environment or to allow a human companion (114), whether disabled, to remotely control and guide it through a robot body interface using one or more application programming interfaces (APIs) (116).

Description

Technical Field

[0001] This invention relates generally to the field of automated robots, and in particular to an intelligent automated robot for autonomous shopping, companionship, assisting with purchases, and carrying luggage during travel and shopping. Background Technology

[0002] From the perspective of existing technology, we have observed continuous efforts to develop and improve intelligent robots for shopping. As illustrated in the study "Shopping with a Robotic Companion" (Bertacchini, F., Bilotta, E., & Pantano, P. (2017). Computers in Human Behavior, 77, 382–395), this research describes a robot placed in shopping venues to serve numerous customers. It acts as a sales assistant, providing services, understanding customer emotions, and attempting to influence customer purchasing decisions. Its goals are: to understand the social interaction between the robot as an assistant and customers; to analyze the verbal and nonverbal communication and emotional expression during the interaction; to identify specific cognitive structures to be developed to enhance the robot's potential to assist people in real life; and to create a machine learning system with numerous specific features and dedicated units for nonverbal behavior, such as gestures and body language, as well as verbal sentiment analysis, to link emotions and emotional language in the robot's database with the store's database (store product-customer data, including personal information and their accounts on social networking sites). The data comes from the robot's emotional expression, nonverbal communication gestures, voice emotion analysis, and analysis of the customer's private social networking sites. The robot recognizes people through facial recognition and identifies gender through a camera. From the perspective of existing technology, the robot in this study is not equipped with solar panels, an integrated multi-layer navigation system, or a connection to the accompanying human user via peripheral devices. It cannot accompany the user during their visit, nor can it be remotely controlled via an application programming interface (API) system and device. Furthermore, the robot lacks electronic payment technology, has no containers for storing shopping baskets / carts, no integrated robotic system for augmented reality, virtual reality, and mixed reality, and no interactive display screen. This invention, however, incorporates all these functions; it is a personal automated robot that can assist its companion in purchasing goods and carrying luggage during visits and shopping. The robot's configuration data comes from (the location of stores in indoor and outdoor environments and their routes to and from stores—data related to the personal companion's shopping orders). This data is input into the robot through coded instructions, enabling it to perform product selection operations while accompanying a human companion on a tour, or to perform corresponding operations based on previous tour and shopping itinerary information and data stored inside the robot, or based on previously visited locations, or based on the coded instructions and directions to be received.Robots use short-range communication technologies such as sensors and lenses to identify products that need to be purchased, and enhance their processing, classification, analysis, and decision-making capabilities through artificial intelligence algorithms. At the same time, by integrating robot systems with augmented reality, virtual reality, and mixed reality technologies, as well as integrating multi-layer navigation systems, robots can achieve autonomous or manual control and guidance of their paths, thereby enabling visual perception, information processing, and information transmission and exchange.

[0003] Furthermore, a video posted on YouTube on October 3, 2019 (titled "Training a Robot at Home to Help Humans") https: / / www.youtube.com / watch?v=6IGCIjp2bn4 showcases a home personal assistant robot designed to perform household chores such as tidying and cleaning. Its data comes from user commands and simulations of user actions, and it identifies objects through a camera. From a technological standpoint, the robot in the video is equipped with a limited autonomous navigation system and a limited virtual reality system, but it lacks a solar panel, does not connect to the user via peripheral devices, and cannot accompany the user while they explore. It also lacks electronic payment services, a system capable of using artificial intelligence to interact and communicate with humans using language, and an advanced language processing system for understanding and generating natural dialogue. Additionally, its structure lacks containers for storing shopping baskets / carts, an integrated robotic system for augmented reality, virtual reality, and mixed reality, an interactive display, and an integrated multi-layered navigation system. This invention incorporates all these functions; it is a personal automated robot that assists its companion in purchasing goods and carrying luggage during a tour. It is capable of interacting and communicating with humans using artificial intelligence technology and is equipped with an advanced language processing system that can understand and generate natural dialogue. The robot's configuration data comes from (the locations of stores in indoor and outdoor environments and their routes—data related to the personal companion's shopping orders). This data is input into the robot via coded instructions, allowing it to perform product selection operations while accompanying its human companion, or to perform corresponding operations based on previously visited tour and shopping itinerary information and data stored within the robot, or based on previously visited locations, or based on coded instructions and directions to be received. The robot uses short-range communication technologies such as sensors and lenses to identify products to be purchased and enhances its processing, classification, analysis, and decision-making capabilities through artificial intelligence algorithms. Simultaneously, by integrating a robot system with augmented reality, virtual reality, and mixed reality technologies, as well as an integrated multi-layer navigation system, it achieves autonomous or manual control and guidance of the robot's path, thereby enabling visual perception, information processing, and information transmission and exchange.

[0004] Furthermore, U.S. Patent Publication No. 2020061839 (publication date: February 27, 2020) discloses a mobile robot designed for use in commercial or industrial environments, such as office buildings or retail stores. This robot can patrol along one or more paths within a building and can detect violations of safety policies by objects, building infrastructure, security systems, or individuals. In response to detected violations, the robot can perform one or more safety actions. The robot may be equipped with a removable canvas cover, allowing sensors inside the robot body to capture signals propagating through the canvas. Additionally, the robot can scan RFID tags on items within the area, such as tags associated with inventory. Similarly, the robot can create or update one or more semantic maps for use when navigating the area and measuring compliance with safety policies. From the perspective of existing technology, this robot is not a personal robot, nor does it connect with the accompanying user through peripheral devices. It cannot accompany the user during their visit, and it lacks electronic payment services, a system capable of using artificial intelligence to interact and communicate with humans, an advanced language processing system for understanding and generating natural dialogue, a container for storing shopping baskets / carts, and an interactive display screen. This invention, however, incorporates all these functions. It is a personal automated robot that can assist its companion in purchasing goods and carrying luggage during a visit. It can interact and communicate with humans using artificial intelligence and is equipped with an advanced language processing system capable of understanding and generating natural dialogue. The robot's configuration data comes from (the location of stores in the indoor and outdoor environment and their routes—data related to the personal companion's shopping orders). This data is input into the robot via coded instructions. While accompanying the human companion on a visit, the robot performs product selection operations, or executes corresponding operations based on previous visit and shopping itinerary information and data stored within it, or based on previously visited locations, or based on the coded instructions and directions to be received. Robots use short-range communication technologies such as sensors and lenses to identify products that need to be purchased, and enhance their processing, classification, analysis, and decision-making capabilities through artificial intelligence algorithms. At the same time, by integrating robot systems with augmented reality, virtual reality, and mixed reality technologies, as well as integrating multi-layer navigation systems, robots can achieve autonomous or manual control and guidance of their paths, thereby enabling visual perception, information processing, and information transmission and exchange.

[0005] Reviewing existing technologies, we find this invention novel and inventive because no personal automated robot currently assists its human companion in reaching a shopping destination, performing shopping operations, and carrying luggage during the visit. Furthermore, this robot possesses the ability to interact and communicate with humans using artificial intelligence technology and an advanced language processing system, capable of understanding and generating natural dialogue, and is equipped with solar panels. The robot's configuration data comes from the location of stores in indoor and outdoor environments and their routes—data related to the personal companion's shopping orders. This data is input into the robot via coded instructions, enabling it to perform product selection operations while accompanying the human companion, or to perform corresponding operations based on previously visited shopping itineraries and data stored within the robot, or based on previously visited locations, or based on coded instructions and directions to be received. The robot utilizes short-range communication technologies such as sensors and lenses to identify products to be purchased, and enhances its processing, classification, analysis, and decision-making capabilities through artificial intelligence algorithms. Through an integrated augmented, virtual, and mixed reality robot system, a multi-layered navigation system, technology and digital media input / output units, and transmission and reception units, the robot's path is automatically or manually controlled and guided to achieve visual perception, information processing, transmission, exchange, and information input and execution. Summary of the Invention

[0006] This invention relates to an intelligent automated robot for autonomous shopping and companionship. In view of the problems of the prior art, this invention proposes a personal automated robot that can act as a companion and assistant during sightseeing and shopping, responsible for purchasing goods and carrying luggage. Its integrated appearance simulates a hybrid form of humanoid and mechanical robots. Therefore, this invention achieves several objectives, including enabling the robot to perform purchasing operations via Near Field Communication (NFC) technology. It also aims to recognize the patterns and behaviors of its owner and simulate and independently perform tasks based on data and information collected or previously input. Furthermore, this invention aims to enable the robot to perform on-site interactive tasks according to pre-programmed instructions, or to achieve remote manual control via Application Programming Interfaces (APIs), Graphical User Interfaces (GUIs)—interfaces configured on the user end of the robot owner—and through integrated Augmented Reality (AR), Virtual Reality (VR), and Mixed Reality (MR) technologies, and by integrating multi-layered navigation systems (such as Geographic Information Navigation Systems, Global Positioning Systems (GPS), Autonomous Navigation Systems (AN), and Inertial Navigation Systems (INS)). The robot incorporates Global Navigation Satellite Systems (GNSS), and includes technology and digital media input / output units, transmission and receiving units, and the ability to interact and communicate with humans using artificial intelligence technology and advanced language processing systems. It can understand and generate natural dialogue (autonomous dialogue mobile robot) and connect via short-range / long-range communication technology to perform tasks assigned to it. This robot is designed to accompany users, providing assistance and carrying luggage while shopping and exploring different environments. The invention also aims to help people with special needs enjoy a pleasant shopping experience without the burden of carrying shopping items or experiencing inconvenience while walking. Therefore, one embodiment of the invention is a personal companion robot that can assist its owner in shopping and walking. The robot performs autonomous movement according to pre-set computational instructions, which consist of a set of commands written in a specific programming language. These commands are input into the computer to perform specific tasks, following the specific syntax rules or digital representation of program commands for each programming language. Text commands are converted into a series of zeros and ones that the computer can directly understand, along with artificial intelligence algorithms associated with a set of instructions and logical rules. This enables the system and software to use machine learning techniques and artificial neural networks to simulate different forms of human intelligence and to autonomously configure robot data, operations, behaviors, and site movement, or to track or follow a human companion wearing an external terminal unit. This terminal unit is identified and read via short-range communication technology and controlled and guided by an accelerometer to measure the robot's linear acceleration in three dimensions (x, y, z), used to detect motion and vibration and determine position and velocity, providing information about changes in body acceleration and linear velocity, thereby helping to estimate the robot's position, velocity, and dynamic balance.This technology uses radio frequency identification (RFID) to identify items based on one or both of the aforementioned instructions. The external terminal unit can be worn on the wrist or connected and synchronized between devices and technologies (API-API-GUI), enabling two or more applications to communicate and interact. The robot follows its owner, automatically recording paths, product shapes, how the owner interacts with their surroundings, and checkout locations, so it can perform these tasks independently later. It saves destination paths, store locations, and shopping item information through an internet-connected geographic information navigation system (via wireless communication technology or an internet chip). This allows it to later go to the target store, identify products using previously captured camera photos, and utilize visual recognition and augmented reality or mixed reality interaction technologies. It then locates the previously saved store cashier, communicates with the cashier via audio input / output units, completes payment using a screen equipped with electronic payment processes and pre-stored bank card object identifiers, and finally retrieves shopping bags or items from the store owner, carrying them by hand or placing them in a personal shopping basket. The gyroscope sensor plays a crucial role in this process. These rotational sensors are used to measure angular velocity as well as changes in direction and attitude. Their operation is based on rotational dynamics and the law of conservation of angular momentum, providing precise angular information about the robot's three axes and enabling applications in navigation, position control, and balance. Angular velocity sensors measure the robot's angular velocity about its three axes to determine direction, attitude, and angular stability, providing information about changes in direction and rotation about the axes, and working in conjunction with gyroscopes and accelerometers to achieve balance. Brief Description of Drawings

[0007] Figure (1): Showing the overall appearance of the robot.

[0008] Figure (2): Showing a scene of the robot accompanying its owner on an outing.

[0009] Figure (3): Showing a scene of a robot performing autonomous shopping and sightseeing tasks, including pre-entered instructions or manual control of its movement path, and paying bills on behalf of its owner. Detailed description

[0010] The following description, in conjunction with the accompanying drawings, details some embodiments of the present invention to illustrate some, but not all, of the embodiments. It should be emphasized that the descriptions below are merely examples, and other embodiments of the present invention may take many different forms. Therefore, the embodiments described herein should not be construed as limited to these specific forms, but should be considered as representative examples for those skilled in the art. References Figure 1 , Figure 2 and Figure 3The figure shows an automated robot (100) equipped with artificial intelligence (AI), which connects to its human owner (111) via peripheral devices (115) and is powered by electricity, solar energy, or kinetic energy (108), storing energy in a battery (105). The robot is equipped with multi-functional technology sensors, enabling it to perform tasks independently in the field and move or patrol alongside its human companion (103), carrying items using its hands (110) and a shopping basket (102). The robot features an interactive display screen including a technology and digital media input / output unit (101), a short-range and long-range communication transmission and reception unit (SRC-LRC), which connects to an identification and definition sensor (IIRD) and provides electronic payment services (112), while simultaneously outputting images of the items to be purchased to help the seller identify specific items (113). The robot identifies needs and items via a camera (106) and transmits the information to an electronic data and sensory information processing and storage unit (109) for operation using geographic information and wireless navigation communication technology (GPS-GNS) when autonomously exploring or with a companion. The robot is able to converse with the seller via a natural language input / output processing unit (104). The robot is equipped with augmented reality, virtual reality, and mixed reality (VR-AR-MR) devices to help it learn to simulate new environments when it encounters new environments that it has not previously recognized (107), or to be remotely controlled via a robot body interface, and can be implemented via application programming interfaces (APIs) (116) under the guidance of a normal human or a disabled companion (114).

[0011] From the perspective of their operational and functional external and internal features, these innovative embodiments are not a final description in themselves, as they enable the implementation and operation of various embodiment models related to the field of the present invention for personal companionship and carrying shopping items. However, they are characterized by the addition of unique innovative features, such as performing direct purchase operations, shopping, and communicating with one or more objects via voice or text through audio and video media-driven tools and devices, as well as virtual or direct visual transmission, and using tools and systems with physical and cloud databases as needed, as well as artificial intelligence technology software, and even, when necessary, through application programming interfaces (APIs) and Internet of Things (IoT) technology devices, with their features managed and controlled by human companions through a body-robot interface. Human companions can remotely command intelligent robots to execute purchase orders or receive products from third parties using electronic payment technologies. This can be achieved by storing bank card data and using interactive screens, audio media, or short-range communication technologies that support electronic and Visa payments. Advanced algorithms can synchronize haptic feedback with user and robot movements, and motion mapping technology can be used to map the user's body movement trajectory based on the robot's kinematics, taking into account factors such as limb length, joint limitations, and workspace constraints. Adaptive and context-aware mapping technologies can be employed to modify control schemes based on tasks, user preferences, or robot capabilities. Multimedia interaction technologies can also be used to combine body movements with other input methods such as voice, gaze, and touch. Regarding the robot's journey to the store, it relies on geographic information mapping technology stored in the intelligent robot's memory or artificial neural network simulation using artificial intelligence systems and technologies to calculate dimensions and lengths, directly synchronizing with updated digital maps (GIS-GPS-GNS) to determine the store and destination location. It also calculates the required time and distance based on previously acquired or input data and information, which can be continuously updated as needed. Furthermore, motion capture sensors, such as high-precision inertial measurement units, depth cameras, and markerless optical tracking technology, are used, along with flexible wearable integrated sensors that can be seamlessly integrated into the user interface. Advanced algorithms are employed to integrate these sensors in a suitable manner, consolidating multi-sensor data for more robust and accurate motion tracking. This also accelerates the movement of the intelligent robot, enabling it to walk alongside or accompany a shopping companion at a predetermined, appropriate speed, or through incremental and decremental acceleration simulation. This is achieved through accelerometer sensors connected to measure the robot's linear acceleration in three dimensions (x, y, z). These sensors detect motion and vibration, determine position and velocity, and provide information about changes in body acceleration and linear velocity, thus helping to estimate the robot's position, velocity, and dynamic balance.The robot can have internal or external spaces for storing shopping items, and may even have sturdy handles for carrying shopping items or travel essentials. This invention includes or integrates compatible systems, devices, tools, and techniques in its various innovative methods and styles. These tools and techniques can improve the performance of tasks and operations relevant to the scope of this invention, specifically including: reactive machines, limited memory, theories of mind, and self-awareness. This parallels the aforementioned methods and approaches to ensure ethical considerations within the scope of this invention, namely as an intelligent automated robot for autonomous shopping and companionship, thereby highlighting its unique innovative value and enhancing its added value relative to existing industrial technologies, utility models, and prior patents.

[0012] In these embodiments, if a human companion is shopping with the intelligent robot, the robot executes the movement instructions for the purchase task. The robot begins scanning and storing data via an external lens synchronized with geographic information maps. These maps are associated with dimensions, lengths, and structural volume shapes, forming sequential guide points and markers for use when instructions are received to proceed to the purchased items. As the human companion selects desired items or anticipates subsequent purchases, these items are categorized by preference list and stored in a multi-level database by the intelligent robot, including primary and secondary detailed data, general information, and detailed information. Digital scanning is performed by reading the robot's barcode identifier, taking a photograph, or manually entering text format to find the name, price, store name, and store location coordinates of the items to be purchased. This information is then processed using digital geographic information maps to create a path to the desired destination, thereby executing the purchase task. When the human owner is resting in a facility within the shopping complex after completing their shopping, they can issue instructions for the automated robot to shop and perform the purchase task on their behalf, and then wait for the robot to complete the specific shopping task. The technology and functionality of intelligent digital camera lenses and sensors are used for scanning, processing, sorting, classifying, and matching operations, using one or more sensor devices to acquire target features of images and shapes, as well as their content and meaning. These devices include numerous light sensor cameras, distance sensors, ray imaging devices, radar, and ultrasonic cameras, enabling intelligent robots to extract image features at different levels of precision from image data and classify these features into: global features, such as color and shape; local features, such as corners, corner detection, and SIFT features; and detection / segmentation, the purpose of which is to determine which points or regions in the image are important for subsequent operations, such as selecting a unique set of marker points to segment one or more images containing the target object or expected interaction areas. Furthermore, there are advanced operations: at this stage, the input data is a small subset of data, such as a set of points or regions in an image suspected of containing the target object, and the remaining operations perform the following steps: ensuring that the acquired data conforms to the task assumptions and proposed operational specifications, and is consistent with the performance and implementation within the scope of this invention; aiding in estimating specific information and data values ​​for one or more tasks within the scope of this invention, such as object orientation or object size; and classifying the identified shapes, objects, and their surrounding environment. As mentioned earlier, direct communication and interaction technologies provide a crucial pathway for ordering products from human sellers through intelligent robots. This ordering method can be automated based on buyer-seller negotiation behavior and language information stored in the AI ​​engine server, in conjunction with a voice dialogue server. Alternatively, the voice can be converted into digital text readable by human sellers, or the management of the buyer-seller negotiation process can be transferred to the robot's owner, allowing them to complete the purchase process through direct communication with human sellers, thus realizing a transformation of the intelligent robot's role. If necessary...This can be achieved through personal virtual remote interaction technology—utilizing visual, audio, and text media features integrated into the robot body, such as a virtual camera on a digital screen, and using a touchscreen, keyboard, microphone, and speaker as needed and with available options. This can be accomplished in any suitable manner using physical computing devices compatible with embodiments of the invention, which are involved in the operation, management, processing, creation, and linking of the invention, and are combined with hardware and technology and electronic tools and devices. These devices include or contain hardware components suitable for use with embodiments of the present invention, specifically including: multi-layer physical computing servers, memory (read-only memory, random access memory, and fixed random access memory), central processing units, application programming interface units, output units, storage units, ports, cameras, microphones, speakers, artificial intelligence processing electronic circuits, cloud or local or global connectivity via computer-readable storage media with recorded programs, multiple or local or global cloud databases, transmission and reception units, microwave radio waves, radio frequency cables, antennas, multiple sensors including a motherboard, solid-state drives (SSDs) and hard disk drives (HDDs), multiple digital lenses connected to artificial intelligence technologies and systems, SIM card units, and short-range and long-range communication devices and technologies (all conforming to the concept of this patent) for connecting robots and their equipment, as well as digital and physical systems related to their internal and external structures and the cloud, to smart screens, multiple power supplies, multiple hydraulic devices with cables, cables, small solar power supplies, multiple battery units (including connector units), and in any suitable manner including or integrating systems and software compatible with the scope of the present invention, as well as operating systems, microelectronic boards and multi-control circuit Arduino boards and their compatible programming languages ​​(C++, C, Python). This includes PLCs (or Roila, Fortran, multiple Java modules) and electronic circuit control boards conforming to the International Standard for Programmable Logic Controllers (IEC), including their programming languages ​​compatible with the implementation of this invention (sequential function charts, instruction lists, function block diagrams, structured text, ladder diagrams), as well as Raspberry Pi boards or electronic circuit control boards, including multiple models (Raspberry Pi 4, Raspberry Pi 1, Raspberry Pi 2, Raspberry Pi 3, Raspberry Pi Pico, involving multiple GPIO interfaces) or multiple electronic circuits compatible with the operation and control process, for executing digital program commands and converting them into circuits that meet the tasks of operation, management, interaction, motion and power storage, as well as voltage distribution and multiple control, and energy storage and distribution, and in some places, energy is obtained and stored by absorbing sunlight through solar panel technology designed in coordination with the intelligent automated robot body, and also has an innovative function, namely, through kinetic energy technology,Utilizing the electromechanical energy generated during robot movement, the resulting current and voltage are optimized and transmitted to the main energy storage unit or recovered in a backup battery to obtain self-generated energy. This includes kinetic energy system technologies and equipment implemented through connectors and tubing, as well as a touch-interactive user interface screen containing cameras, microphones, speakers, digital data processors, wired and wireless media input / output ports, GND-VCC ports, and external technology terminal units. The intelligent robot can digitally read and identify these external technology terminal units through terminal unit devices connected to electronic circuits, databases, and digital machine engines. These devices are used for IoT drivers, cloud computing processors for near-field or remote response, and are associated with geographic information navigation systems, geographic information systems, and global positioning systems. They also include wireless communication technologies implemented through local internet networks, and communication services managed through satellites and sensor devices such as laser sensors and tilt sensors. These tilt sensors measure the robot's tilt angle relative to the Earth's axis of gravity to determine position, maintain balance, and control movement. They operate by using variable resistors or capacitive sensors to measure angles, providing information about the robot's deviation from its vertical position, thereby helping to adjust balance and correct angular deviations. Ultrasonic sensors (HC-SR04 or equivalent) are used to measure site dimensions and detect the presence of obstacles or the openness of the site to determine the distance between the autonomous robot and adjacent obstacles; infrared sensors are used for personal control via robot actuators or features; or parallel-connected interactive voice response technology connects to services, devices, system APIs, and physical or cloud-based digital data processing database servers, equipped with an engine machine to enhance the understanding of voice patterns and dialogues, and to respond automatically or manually as needed, exchanging words and dialogues through various implementations, converting text to speech, speech to text, or interacting with sign language; NFC near-field communication... Communication technologies are used to support payment and digital settlement processes between consumers, sellers, and third-party electronic payment service providers; Wi-Fi or Bluetooth technologies are used to control, manage, operate, and transmit data and algorithmic program instructions, which are transmitted between the aforementioned connected electronic circuits and converted from electrical signals into primary and secondary physical components of the intelligent robot body. These components execute interactive motion response commands based on pre-prepared and formed digital, computational, algorithmic, and program inputs, or through direct responses obtained from generative artificial intelligence or relying on various electronic sensing technologies (including human motion control or body control), all within the context, tasks, and priorities of this invention. At this time, these connected structural components move within the autonomous shopping robot body, which is an industrial structural design composed of various compatible and harmonious materials used to construct the robot's external body without conflicting with the robot's characteristics and internal components. The implementation forms of its external components are diverse.Simulating human anatomy and combining it with robotic mechanical characteristics, this system achieves movement, walking, and interactive motion responses, with the sequence and synchronization mimicking human movement patterns. Various types of engines and motion-generating actuators and their attachments are driven by electrical and electromechanical power sources, which translate into mechanical and dynamic motion. These power sources work in conjunction with compatible hydraulic components integrated into the external structure, interconnecting structural parts and creating motional harmony among multiple external structural components. This structure includes several parts: a lower structure (right and left feet, right and left legs, right and left thighs); a mid-body structure (upper thigh interface, upper thigh abdominal interface, upper abdomen chest interface, right and left arms); an upper body structure (right and left shoulder connection, neck connection above the shoulders); and a head structure (head connection).

[0013] It can walk, stroll, or accelerate through the movement of its lower structure, mimicking human walking motion and driven by dynamic hydraulic energy; or it can simulate robotic movement through miniature circular wheels made of materials suitable for absorbing the impact of ground friction and helping to enhance the overall balance of the robot's body structure. These wheels can be arranged individually or distributed under or beside the feet of the lower body, and their movement is driven by a mixture of electrical and electromechanical power sources. In this mode of movement, we can utilize the regenerative electrical energy generated during the acceleration and rotation of the miniature circular wheels using electromechanical technology, transferring the energy to a backup battery via electronic circuitry for recycling, working in conjunction with the main battery. Notably, in both different lower structure movement modes, the remaining structures (middle body, upper body, and head) will cooperate with the movement of the lower structure to ensure the flexibility, regularity, and overall balance of the robot's body structure. Force sensors measure the forces and torques acting on the robot's structure and moving limbs to determine dynamic balance and load distribution. Their working principle is to convert forces into measurable electrical signals, providing information about the strong interactions between the robot and its surrounding environment, helping to adjust the robot's movement and enhance stability and balance. Furthermore, the remaining structures (middle half, upper half, head) will perform motion tasks in parallel based on the nature of the motion interactions. These tasks are consistent with the behavior of autonomous shopping tasks, and their data has been pre-input according to software and algorithms, or acquired independently of generative artificial intelligence and social movement, language, text, and sign language interactions, for the purpose and tasks of autonomous shopping within the scope of this invention. The execution methods may include or combine the use of power sources such as electromechanical, hydraulic, pneumatic, solar, or piezoelectric, or one of these may be selected as available or suitable. This makes the various motion methods innovative and unique, enabling integrated and collaborative work to accomplish tasks within the scope and field of this invention. The deep learning algorithms of generative artificial intelligence and the input program instructions will exchange and share operations, enabling them to create specific representations of the nature of external and internal factors, whether these factors are logical, engineering, physical, or technical, by recognizing shapes and structures in large amounts of data and establishing connections between different perceptions. When analyzing a neural network, it examines every detail and specific implementation of the shape, structure, path, and characters presented to it. It distinguishes the steps between them using dimensions and a business facility map (including the arrangement of store locations, signage, and layers of paths leading to or from stores), and processes all relevant information appropriately. By establishing connections between all features, it can process and infer appropriate situations, thereby making correct behavioral decisions, guiding individuals to move and walk to their designated destinations, and easily avoiding obstacles even in the most complex situations. Claims (as amended under Article 19 of the Treaty) 1. An intelligent robot system for autonomous shopping and accompanying humans, comprising: (a) An enhanced artificial intelligence robot unit that connects to a designated user via peripheral devices; (b) A multi-source power system comprising a power source connected to a battery, solar cells integrated into the robot structure (in the form of a jacket worn in the middle and upper middle of the robot), and a system for generating its own power through kinetic energy conversion; (c) An item carrying subsystem, comprising a shopping basket and a robotic arm; (d) A multimodal interaction subsystem, comprising an interactive display screen, a natural language processing unit, an electronic payment system, an interactive sign language communication system implemented through the display screen, and a bargaining and purchasing negotiation unit; (e) An integrated sensing system, comprising a multispectral camera, a data storage and processing unit, and an integrated navigation system combining geospatial navigation and global positioning technologies; (f) A learning and adaptive system, comprising augmented reality, virtual reality and mixed reality subsystems for simulating and learning new environments; (g) An intelligent adaptive motion system that enables a robot to follow and walk alongside a human user, employing an accelerometer to measure the robot's linear acceleration in three-dimensional space and automatically adjusting the robot's speed by gradually increasing and decreasing the acceleration to match the user's speed; (h) A hybrid motion system; The system is characterized by the following capabilities: Accompanying users during the shopping process and assisting them with carrying items; Based on pre-learning of user behavior, it independently executes shopping operations; During navigation, the movement speed is automatically adjusted to match the speed of the human user. Interact with merchants and users in multiple ways, including voice, text, and sign language; Based on the negotiation information and behavior stored in the AI ​​engine server, the robot can automatically negotiate buying and selling transactions or transfer the negotiation management authority to the robot's controller. Execute electronic payment transactions; To meet the needs of different users, including people with disabilities. 2. A method for operating an intelligent robot for autonomous shopping and companionship, comprising: (a) Identify the identity and location of a designated user through peripheral devices connected to the robot; (b) Analyze the shopping environment using multiple sensors and multispectral cameras, and build a digital map of the surrounding environment; (c) In a shopping environment, autonomous navigation can be achieved by following the user or based on a pre-stored path; (d) Identify and record products in real time; (e) Store the purchased goods in an integrated shopping basket or carry them using a robotic arm; (f) Interact with merchants and users in a variety of ways, including voice, text and sign language communication through interactive screens; (g) Based on the negotiation behavior stored in the machine intelligence engine server, automatically negotiate buying and selling transactions with human sellers, or transfer management rights to users; (h) Complete payment transactions electronically; (i) Analyze and store shopping data to improve users' future shopping experience; (j) Manage multiple power supplies to achieve the longest possible runtime; (k) Utilize accelerometers and artificial intelligence algorithms to automatically adjust and control the robot's movement speed so that it moves in sync with human users, ensuring that the robot's movement is synchronized with that of human users and that it can match the movement patterns of human users; (l) Navigation steps in the shopping environment use a hybrid motion system. 3. The system of claim 1, wherein the peripheral device includes a wearable device, such as a smartwatch, mobile phone, or dedicated controller, the device being equipped with near field communication or Bluetooth Low Energy technology to ensure continuous and encrypted communication with the robot. 4. The system according to claim 1, wherein the multi-source power supply system comprises: Micro solar photovoltaic cells integrated in the middle and upper-middle parts of the robot structure, in the form of a flexible jacket; (b) A system for generating self-generated energy during robot movement using electromechanical technology; (c) A system for managing and distributing different power sources to various components of a robot. 5. The system according to claim 1, wherein the multimodal interaction subsystem comprises: (a) A natural language processing unit capable of understanding and generating spoken language and simulating interpersonal dialogue; (b) It is capable of displaying interactive sign language communication via a digital screen integrated into its external structure; (c) A product image output unit to help sellers identify specific target products. 6. The system of claim 1, wherein the multispectral camera comprises: (a) A thermal imaging unit for identifying objects under low-light conditions; (b) A high-resolution digital imaging unit for identifying products, symbols, and text; (c) A three-dimensional imaging unit for determining object size and measuring distance. 7. The system of claim 1, wherein the learning and adaptive system comprises: (a) An integrated subsystem for augmented reality, virtual reality and mixed reality; (b) Algorithms used to store and analyze information and data from previous navigation and shopping operations; (c) Able to build models for new environments and store them for future use; (d) A mechanism to adapt to user needs, including those of people with disabilities. 8. The system of claim 1, wherein the robot's structure comprises four main parts: (a) The lower structure, including two feet, two legs and thighs, and equipped with a musculoskeletal system; (b) Midbody structure, including the abdominal and chest interfaces, two arms, and shopping basket; (c) The superstructure, including the shoulder and neck interfaces; (d) Header structure, including the header interface; These structural components are all made of lightweight, highly durable materials to facilitate carrying items and easy movement. 9. The system of claim 1, wherein the integrated navigation system comprises: (a) A geospatial navigation unit; (b) A global positioning system; (c) An autonomous navigation system; (d) An inertial navigation system; (e) A global satellite navigation system; This enables the robot to navigate precisely in both indoor and outdoor environments. 10. The system of claim 1, wherein the electronic payment system comprises: (a) A communication unit for transmitting financial data; (b) An interface compatible with various payment systems; (c) Functionality for storing and managing payment identifiers; (d) An interactive interface that enables users to complete payment transactions. 11. The system of claim 1, further comprising functions for supporting persons with disabilities: (a) A system for interactive sign language communication via a digital screen; (b) A user interface that can be adapted to the needs of people with various disabilities; (c) Voice guidance provided for visually impaired individuals; (d) A remote control system that enables a disabled user to control a robot to perform shopping tasks. 12. The system of claim 1, wherein the buyer-seller negotiation unit comprises: (a) Negotiation information and actions stored in the machine intelligence engine server; (b) Capable of converting speech into digital text readable by human sellers; (c) A mechanism for transmitting negotiation process management and buying and selling activities to a robot controller; (d) An interface that allows for personal virtual remote interaction using visual, audio, and text media tools integrated into the robot body. 13. The system according to claim 1, wherein the intelligent adaptive motion system comprises: (a) An accelerometer for measuring the linear acceleration of a robot in three dimensions (x, y, z); (b) A gyroscope sensor used to measure angular velocity and changes in direction and attitude; (c) Artificial intelligence algorithms that control and automatically adjust the robot’s speed to match the speed and movement of human users; (d) A human user tracking and sensing system that uses peripheral devices, radio frequency identification technology, and short-range and long-range communications; (e) A mechanism for maneuvering and obstacle avoidance when following a human user. 14. The system of claim 1, wherein the lower structure of the robot includes a hybrid motion system that incorporates: (a) A mode of locomotion that uses the feet and legs to walk in narrow passages and rugged terrain; (b) A mode of movement that allows for rapid movement through a wide, flat passageway via wheels integrated under or beside the feet; (c) A system that switches between two modes of motion based on ambient conditions, available energy levels, and the weight of the carried items. 15. The method of claim 2, wherein the steps of interacting with the seller and the user include: (a) Speech recognition and processing; (b) Display interactive sign language communication on an interactive screen; (c) Determine the appropriate communication medium based on user needs. 16. The method of claim 2, wherein the step of analyzing the shopping environment comprises: (a) Extracting image features at different resolution levels; (b) Classify features into general features (e.g., color and shape) and local features (e.g., corners); (c) Identify and segment important regions in the image; (d) Construct a map of the surrounding environment, including shops, corridors, and reference points. 17. The method of claim 2, wherein the step of conducting the buying and selling negotiation process includes: (a) Present the product to the seller via digital screen or audio description; (b) Perform automated communication based on information stored in the machine intelligence engine server; (c) Convert speech to written digital text when necessary; (d) If necessary, transfer the management of the negotiation process to the robot's controller. 18. The method of claim 2, wherein the method comprises learning by: (a) Store information and data from previous navigation and shopping operations; (b) Analyze previously purchased products; (c) Improve navigation paths based on prior experience. 19. The method of claim 2, wherein the step of managing multiple power supplies comprises: (a) Monitor the energy level of each power source; (b) Switching between different power sources; (c) Utilize energy obtained from motion and solar energy. 20. The method of claim 2, wherein the step of adjusting the robot's moving speed comprises: (a) Measure the user's linear acceleration of the human body using sensors in a peripheral device; (b) Simulate the acceleration increments and decelerations of a user's walking motion; (c) Adjust the distance between the robot and the user to maintain a safe and comfortable distance; (d) Initiate obstacle avoidance while continuously tracking the user. 21. The method of claim 2, wherein the step of navigating in a shopping environment uses a hybrid motion system that can switch between the following modes: (a) Using bipedal walking in narrow, crowded spaces; (b) Use of wheels for movement in open spaces and horizontal corridors; (c) Based on the analysis of the surrounding environment, remaining energy level and weight of carried items, the appropriate movement mode is automatically selected.

Claims

1. An intelligent automated robot for autonomous shopping and companionship, comprising: An automated robot (100) equipped with artificial intelligence (AI) is connected to its owner via a peripheral device (115). The robot has a shopping basket (102) and two arms (110), is powered by a main power supply and a sustainable power supply (108), and stores electrical energy in a battery (105). The robot is equipped with a robotic system unit that is capable of interacting with human users, maintaining balance and stability, and performing field tasks. It includes at least: a robotic structure; and an integrated set of various sensors, including gyroscope sensors, accelerometer sensors, angular velocity sensors, tilt sensors, force sensors, and vision sensors. An intelligent control unit capable of processing data from sensors and making real-time control decisions to maintain balance and stability and perform field tasks; the unit is adaptable to changing environments and interprets and guides human motion signals, enabling the robot structure to interact with its surroundings and process natural language and sensory information (103); a screen (101), electronic payment services (112), and a technology media input / output unit (113); the robot identifies needs and items via a camera (106); a data processing and storage unit (109) for subsequent personal navigation using wireless geographic information navigation and a global positioning system (GPS-GNS); the robot is able to converse with sellers via an audio input / output unit (104); the robot is equipped with a device and system for interacting with the real environment to help it learn to simulate new environments when encountering previously unrecognized new environments (107).

2. The intelligent automated robot according to claim 1, wherein the peripheral device (115) may be a watch, mobile phone, control device, screen or other wireless control device connected in a suitable manner, and is capable of working with Internet of Things (IoT) devices and technologies.

3. The intelligent automated robot according to claim 1, wherein the power source (108) generates solar energy through micro solar energy technology, converts the current generated by the photovoltaic cells in the solar energy unit into alternating current, and the power source is designed in the form of a jacket on the automated robot body and is worn according to the position ratio of its middle half body and upper half body structure.

4. The intelligent automated robot according to claim 1, wherein the camera (106) may be a thermal imaging camera, a digital camera, a photographic camera, a three-dimensional or four-dimensional (4D-3D) camera, or have the above functions.

5. The intelligent automated robot of claim 1, comprising a virtual reality (VR) display unit using an application programming interface (API) and a technology lens (116), an augmented reality (AR) sensing unit using cameras and sensors connected to an Internet of Things (IoT) device (107), a mixed reality (MR) processing unit, and an advanced operating system driver for configuring real-world interaction technologies.

6. The intelligent automated robot according to claim 1, wherein the robot structure is constructed of lightweight and heavy materials in an appropriate manner and designed to mimic the shape of the human body structure, and the robot design is completely vertical and partially horizontal in terms of component distribution, including: The lower structure (wheeled moving structure base located below or near the left and right foot interfaces, right and left legs, right and left thighs), the middle half-body structure (pelvic front and back interfaces above the thighs, abdominal interface above the pelvis, chest interface above the abdomen, right and left arms), the upper half-body structure (left and right shoulder front and back interfaces above the shoulders, neck interface above the shoulders), and the head structure (head front and back interfaces above the neck); it includes or integrates various motion power sources, such as artificial muscle actuators, pneumatic, hydraulic, electric, magnetic, piezoelectric, electromechanical, mechanical and dynamic, as well as micro solar energy, servo motors, DC motors, stepper motors, and stepper mode motors.

7. The intelligent automated robot of claim 1, comprising a central processing unit (107) integrated and connected according to component characteristics and physical sensing or cloud computing components, and capable of processing and programming operations, data analysis, and transmission and reception of signals, instructions and controls, in any suitable manner within the field of this invention; and comprising a human-machine interface (HMI), a human-machine interface HMI-PLC, a programmable logic controller PLC-SCADA, and microelectronic boards and multi-control circuit Arduino boards and their compatible programming languages ​​(C++, C, Python or Roila, Fortran, multiple Java modules) and electronic circuit control boards PLCs conforming to the International Standard for Programmable Logic Controllers (IEC), including their programming languages ​​compatible with the implementation of this invention (sequential function chart, instruction list, function block diagram, structured text, ladder diagram), and Raspberry Pi boards or electronic circuit control boards, including various models (Raspberry Pi 4, Raspberry Pi 1, Raspberry Pi 2, Raspberry Pi 3, Raspberry Pi Pico (involving multiple GPIO interfaces), or multiple electronic circuits compatible with operation and control processes, is used to execute digital program commands and convert them into circuits that meet the tasks of operation, management, interaction, motion and storage of power supply, as well as voltage distribution, multiple control, processing and analysis, and to process digital and graphical data using artificial intelligence technologies and systems.

8. The intelligent automated robot of claim 1, comprising sensor devices (103) and the tools and techniques required for wireless short-range and long-range communication devices and managed wave communication devices.

9. The intelligent automated robot of claim 1, comprising a graphical programming environment - Simulink - Geographic Information Science (GEOMATICS), Geographic Information System (GIS), Global Positioning System (GPS), laser scanners, systems and technologies for digital mapping, possessing their various functional and operational elements - Geographic Information Science, Geography and Global Positioning System, and their diverse structures, including general geospatial structures, open-source software geospatial structures and external conditions, commercial off-the-shelf (COTS) geospatial structures: Esri, with fixed and streaming data sources, and COTS geospatial image structures: Esri's ArcGIS imagery and Azure Orbital, and open-source software COTS geospatial image structures: Azure Space to Analysis Ready Dataset, Platform as a Service (PaaS), PostgreSQL Digital Twins and Cosmos DB, Data Factory, Orbital-Power BI.

10. The intelligent automated robot according to claim 1, wherein the hardware components include multiple servers, memory (read-only memory, random access memory, and fixed random access memory), central processing unit, transmitting and receiving unit, input and output unit, user and graphical interface unit, storage unit, port, camera, microphone, speaker, multiple cloud or local or global artificial intelligence processing units, multiple local or global cloud databases, microwave radio frequency unit, radio frequency cable, antenna, sensor unit, motherboard, solid-state drive (SSD) and hard disk drive (HDD), multiple digital lenses related to artificial intelligence applications, physical and digital SIM card unit, short-range, long-range, wide-area or satellite communication unit compatible with the device and software described in this patent, smart screen, power supply compatible with physics engine, wires, cables, small solar cells, and multiple battery units including connection unit.

11. The intelligent automated robot of claim 1, comprising computing devices and systems, artificial intelligence (AI) technologies and tools, and related methods, including: Neural networks, evolutionary computing, computer vision, cognitive computing, robotics, expert systems, speech processing, natural language processing (NLP), planning, deep learning, sentiment analysis, and machine learning.

12. The intelligent automated robot according to claim 1, comprising or integrating the technology and functions of intelligent digital camera lenses and sensors for scanning, processing, sorting, classifying, and matching operations to acquire target features of images and shapes and their contained content and meaning, and using multiple sensing devices, including multiple light sensor cameras, distance sensors, ray imaging devices, radar, and ultrasonic cameras, thereby enabling the intelligent robot to extract image features of different precision levels from image data and classify these features into: global features, such as color and shape; local features, such as corners, corner detection, and SIFT features; and features related to detection / segmentation for determining which points or regions of the image are important areas for subsequent operations, such as selecting a unique set of marker points, segmenting the image of the region containing the target or expected object, and realizing interactive responses through sign language display on a digital screen integrated into its external structure, supplemented by technical tools and devices for audio and video media.

13. The intelligent automated robot of claim 1, comprising tools and techniques for systems and devices that can improve the performance of tasks and operations related to the scope of the invention: reactive machines, limited memory, theories of mind, and self-awareness. This is in parallel with the methods and approaches described above.

Images