Artificial intelligence interactive projection all-in-one machine

Abstract

The invention discloses an artificial intelligence interactive projection all-in-one machine, and belongs to the technical field of artificial intelligence application. The all-in-one machine is mainly composed of an electric lifting machine box, a movable chassis and a fixed machine box, is made of metal materials and supports voice instructions or capacitive touch screen control. The electric lifting machine box can flexibly adjust the projection angle and height, the movable chassis can automatically adjust a projection picture, and various components such as a motion capture camera and a high-speed photographic apparatus and a generative artificial intelligence system are integrated. The system has multiple functions of content generation, document processing, action interaction and the like, and can realize operations such as picture book generation according to voice instructions, conversion of scanned documents into interactive patterns and the like. Compared with the prior art, the system is convenient and efficient in deployment, flexible and accurate in projection function, rich and innovative in function and rich and intelligent in interactive experience, can meet the professional and daily use requirements in multiple fields, and effectively improves the performance of projection equipment and the user experience.

Description

Technical Field

[0001] The present invention relates to the field of artificial intelligence application technology, and in particular to an artificial intelligence interactive projection all-in-one machine. Background Art

[0002] The interactive projector integrates projection technology and interactive technology, and is widely used in many fields such as homes, offices, schools and entertainment venues. It is usually composed of a projection module, a touch sensing module, a control circuit, an audio system and a shell. The projection module is responsible for projection, the touch sensing module captures touch operations, the control circuit connects and coordinates the work of each module, the audio system provides sound output, and the shell plays a protective and supporting role.

[0003] However, there are many problems with the interactive all-in-one projectors on the current market. First, the projection direction is single, and most of them can only be projected on the wall or the ground. The application scenarios are limited and it is difficult to meet the diverse needs of users. Second, the functions are relatively basic and single, mainly focusing on simple projection and interactive functions, lacking depth and diversity. Third, the projected image cannot be automatically adjusted according to environmental changes. In actual use, it is often necessary to manually move and position the device, which is cumbersome and inefficient. Most importantly, traditional devices generally lack artificial intelligence interactive technology, and do not have functions such as generative artificial intelligence, voice dialogue, text scanning, and face recognition, and cannot provide users with an intelligent and personalized interactive experience. Summary of the invention

[0004] Based on these problems, the present invention aims to create a new AI interactive projection all-in-one machine through innovative design and advanced technology application, and comprehensively improve the performance and user experience of projection equipment. The design idea of ​​the present invention is to solve the existing problems, starting from enhancing the flexibility of projection, enriching the interactive functions, integrating AI technology and realizing automatic adjustment, and is committed to bringing users a more convenient, efficient and intelligent projection interactive experience.

[0005] The present invention is achieved through the following technical solutions:

[0006] The AI ​​interactive projection all-in-one machine of the present invention is mainly composed of an electric lifting chassis, a mobile chassis and a fixed chassis, and is made of metal as a whole. The all-in-one machine supports users to control it through voice commands or a capacitive touch screen, covering equipment startup, mobile chassis adjustment of projection images, projection angle and height adjustment, and various interactive function operations. The all-in-one machine integrates a generative AI system, which, with its powerful semantic understanding and content generation capabilities, can generate relevant content according to user instructions and provide users with a personalized service experience.

[0007] Preferably, the artificial intelligence interactive projection all-in-one machine is characterized in that the electric lifting box is equipped with a structure that can flexibly change the projection angle, and is provided with a projection structure that can be flipped up and down. With the help of a motor and a mechanical mechanism, the projection structure can be quickly flipped between 0 degrees and 90 degrees, easily realizing the function switching of projecting onto a wall or vertically projecting onto the ground.

[0008] Preferably, the artificial intelligence interactive projector is characterized in that the electric lifting box is provided with a lifting motor and a slide rail auxiliary operation device for adjusting the projection height to ensure a smooth lifting process.

[0009] Preferably, the artificial intelligence interactive projection all-in-one machine is characterized by being composed of two electric wheels in the middle and four universal wheels at the four corners. The electric wheels are driven by a high-torque DC motor to provide the main driving force for movement; the universal wheels at the four corners enhance the flexibility of the device's movement and the convenience of steering. The mobile chassis is also equipped with a TOF radar, which collects space information below in real time. The generative artificial intelligence system deeply integrates this data information, uses algorithms, and automatically controls the moving direction and distance of the mobile chassis according to changes in the environmental space. Especially when projecting on the ground, the generative artificial intelligence system can use the TOF radar to sense the contact between the user's legs and the ground projection screen to achieve interaction, thereby improving the ease of use of the device and the interactive experience.

[0010] Preferably, the AI ​​interactive projection machine is characterized by: integrating a motion capture camera, a capacitive touch screen, a high-definition camera, a wireless projection module, a voice recognition module, an audio system, and a host intelligent core computing unit. Among them, the motion capture camera has a high frame rate and excellent resolution; the capacitive touch screen has extremely high touch sensitivity; the high-definition camera has a fast scanning speed and high resolution; the voice recognition module has high sensitivity and strong noise reduction capability; the audio system uses a professional-grade audio unit; the host intelligent core computing unit integrates a generative AI system based on a deep learning architecture, and has the following functions:

[0011] Content generation: Based on the user's voice commands, with powerful natural language processing capabilities and rich creative generation capabilities, it can quickly generate picture books with rich content and vivid plots, as well as challenging and interesting interactive games. The system uses a pre-trained language model with a Transformer architecture. This model is like an intelligent brain that has "learned" a lot of text. By learning from massive amounts of text data, it can understand the semantics and grammatical structure of natural language, and then generate corresponding content according to user commands, bringing users a new creative inspiration and entertainment experience.

[0012] Document processing: Optical character recognition (OCR) technology is used to convert the text in the paper document image scanned by the camera into editable text, and then combined with natural language processing technology, the text is analyzed and understood. Not only can it be accurately converted into interactive patterns, but it can also be further expanded to generate rich related content, such as background stories, knowledge explanations, etc., greatly enriching the diversity and depth of interaction.

[0013] Action interaction: Combined with the user action data collected by the motion capture camera, the action recognition algorithm based on the hidden Markov model (HMM) and deep learning is used to extract features and pattern match the action data to identify the user's action intention. Then highly personalized interactive experience scenes and interactive game modes are generated to achieve natural, smooth and immersive interaction between users and projected content. In simple terms, the device can "understand" the user's actions like a human and make corresponding interesting feedback.

[0014] Ground interaction and screen adjustment: The TOF radar data of the mobile chassis is called to realize the sensing interaction of the contact between the user's legs and the projected screen when projecting on the ground. At the same time, according to environmental changes, such as new obstacles around the device, the image analysis and processing algorithm is used to analyze and adjust the projected screen to realize interactive games based on leg movements.

[0015] Face recognition: The motion capture camera has face recognition function. Through the built-in high-precision image sensor and advanced face recognition algorithm, the FaceNet algorithm based on convolutional neural network learns a large number of face images, extracts the feature vector of the face, and compares and recognizes it with the preset face data in the system. When the user approaches the device, the user's identity is automatically identified, the usage habits and preference information are extracted from the user's historical usage data, and the projection settings are automatically adjusted to provide users with a personalized experience. At the same time, in some interactive scenarios that require identity authentication, such as logging into a specific account and turning on functions with specific permissions, face recognition is used as a safe and convenient verification method, and only authorized users can perform related operations.

[0016] Wireless screen projection: Equipped with a wireless screen projection module, it supports multiple mainstream screen projection protocols such as Miracast, AirPlay and DLNA. The wireless screen projection module establishes a connection with external devices through a Wi-Fi network and uses the corresponding screen projection protocol for data transmission, making it convenient for users to project device content to an external large-screen display and expand usage scenarios.

[0017] Compared with the prior art, it has the following beneficial effects:

[0018] Convenient and efficient deployment: It integrates modern computer technology, digital image processing technology, artificial intelligence technology, voice recognition technology, machine vision technology and other advanced technologies to achieve voice-controlled automatic walking deployment projection function, without manual movement and positioning. The unique mobile chassis design, the two electric wheels in the middle provide stable power, and the four-corner universal wheels enhance flexibility, making the equipment movement more convenient and efficient. Moreover, the electric lifting chassis, self-propelled chassis, and fixed chassis are integrated into a whole, and can be controlled by voice or capacitive touch screen, which further simplifies the operation process and improves the user experience.

[0019] Flexible and accurate projection function: The projection function of the electric lift box is highly accurate and flexible. The design of flipping the projection up and down and flexibly adjusting the projection height meets the diverse projection needs in different scenarios and expands the application range of the equipment. Whether in professional places such as classrooms and conference rooms, or in daily scenes such as home entertainment, the projection angle and height can be easily adjusted according to actual needs to provide users with the best viewing experience. At the same time, the generative artificial intelligence system provides intelligent suggestions and optimization solutions for the adjustment of projection angle and height, further improving the projection effect.

[0020] Rich and innovative functions: The generative artificial intelligence system in the host greatly enriches the functional connotation of the device. It breaks the limitations of traditional device functions and provides users with all-round support from creative inspiration to content generation. In the field of education, it can assist teachers to quickly generate rich and diverse teaching materials and improve teaching effectiveness; in children's education and parent-child interaction scenarios, the function of automatically generating picture books brings children a reading experience full of fun and knowledge; in the field of design, it can provide inspiration and creative references for designers. It meets the professional needs and daily use needs of users in multiple fields such as education, design, and business, further improves the practicality and innovation of the equipment, and makes this artificial intelligence interactive projector have a significant competitive advantage in the market.

[0021] Rich and intelligent interactive experience: It has rich and powerful interactive functions. When projecting on the ground, the TOF radar is installed at the bottom of the mobile chassis, which can sense and interact with the contact between the user's legs and the ground projection screen, and cooperate to realize touch games based on leg movements; when projecting on the wall, the motion capture camera supports somatosensory games based on movements. The multimodal interactive function not only supports voice interaction and touch interaction, but also greatly enriches the application scenarios of motion recognition interaction, bringing users a richer, natural and intelligent interactive experience. The function of converting patterns captured by high-speed scanners into interactive patterns further enhances the interactivity and interest between users and projected content. The connection between voice dialogue and high-speed scanners and generative artificial intelligence systems provides users with new ways to create and interact with games, such as creating picture book games and interactive games based on scanned images, bringing users an unprecedented intelligent interactive experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 The overall structure diagram of an artificial intelligence interactive projection all-in-one machine

[0023] Figure 2 The overall structure diagram of an artificial intelligence interactive projection all-in-one machine

[0024] Figure 3 A flat image of an artificial intelligence interactive projector

[0025] Figure 4 A flat internal structure diagram of an artificial intelligence interactive projector

[0026] Figure 5 A picture of an artificial intelligence interactive projection machine

[0027] Figure 6 An internal structure diagram of an artificial intelligence interactive projector DETAILED DESCRIPTION

[0028] The present invention will be described in detail below in conjunction with the accompanying drawings.

[0029] Device startup and mobile positioning

[0030] Voice start: The user issues a voice command, such as "start the all-in-one projector", and the voice recognition module (1) of the all-in-one projector quickly receives and interprets the command, and transmits the signal to the host intelligent core computing unit. The unit then starts the initialization program of each component of the device, and the modules in the electric lifting box (14), mobile chassis (15), and fixed box (13), such as the motion capture camera (2) and high-speed scanner (3), enter the standby state and prepare for work.

[0031] Touch start: The user can also click the start button on the capacitive touch screen (11), and the trigger circuit transmits the start signal to the host intelligent core computing unit (4), thereby implementing the same device start process.

[0032] Mobile positioning: If the user needs the device to move to a specific location, through voice commands, such as "move to the center of the classroom", the host intelligent core computing unit (4) receives the command and calls the TOF radar (5) of the mobile chassis (15). The TOF radar (5) scans the environment below, determines the surrounding space conditions, obtains the current location information, and uses the built-in path planning algorithm to calculate the best moving path to the target location. The two electric wheels (6) in the middle are driven by a high-torque DC motor to provide the main moving power, and the universal wheels (12) at the four corners flexibly turn according to the moving direction, so that the device moves along the planned path. During the movement process, the TOF radar (5) continues to work and adjusts the moving direction in real time to avoid collisions with obstacles. If the user sets the location through the capacitive touch screen (11), the location can be specified on the capacitive touch screen (11) using a map or manual marking method, and the system also controls the movement of the device according to the above process.

[0033] Projection angle and height adjustment

[0034] Voice control adjustment: After reaching the designated position, the user controls the electric lifting box (14) to adjust the angle and height of the projector (16) according to actual needs through voice commands, such as "raise the projection" or "flip the projection". After receiving the command, the host intelligent core computing unit (4) controls the lifting motor (7) of the electric lifting box (14) to operate. For adjusting the angle of the projector (16), the upside-down flipping projector (16) cooperates with the flipping motor (8) and the flipping mechanical mechanism (9) to quickly flip between 0 degrees and 90 degrees, thereby realizing the function switching of projecting onto a wall or vertically projecting onto the ground. For adjusting the height of the projector (16), the electric lifting box (14) is driven by the lifting motor (7) to smoothly rise or fall along the slide rail (10) auxiliary operation device to change the projection height.

[0035] Touch control adjustment: The user can also adjust the angle and height of the projector (16) by sliding, clicking, etc. on the capacitive touch screen (11). The touch screen converts the user operation into an electrical signal and transmits it to the host intelligent core computing unit (4), which controls the corresponding motors and mechanical components according to the signal content to complete the adjustment of the projection angle and height.

[0036] Interactive function realization

[0037] Personalized experience with face recognition: When the user approaches the device, the face recognition function of the motion capture camera (2) is activated. The built-in high-precision image sensor quickly captures the face image and compares it with the face data preset in the system through advanced face recognition algorithms. If the recognition is successful, the system extracts the user's usage habits and preferences from the user's historical usage data and automatically adjusts the projection settings. At the same time, in some interactive scenarios that require identity authentication, such as logging into a specific account or enabling functions with specific permissions, face recognition is used as a safe and convenient verification method, and only authorized users can perform related operations.

[0038] Ground projection interaction: When the device is projected onto the ground, the user can perform various leg movements in the projection area. The TOF radar (5) installed at the bottom of the mobile chassis (15) captures the contact information between the user's legs and the ground projection screen in real time, and transmits the data to the host intelligent core computing unit (4). This unit is combined with a generative artificial intelligence system to determine the user's intention based on the action data. For example, when the user is playing a ground touch game based on leg movements, the system responds in real time, updates the game screen and score information, and enables the user to interact with the projected content. For example, when the user's leg touches the virtual button in the projection screen, the system can recognize it in time and make corresponding feedback, such as starting a program, switching screens, etc.

[0039] Wall projection interaction: When projecting on the wall, users can interact with the projected content through body movements. The motion capture camera (2) collects the user's motion data in real time at a high frame rate and high resolution, and uses advanced motion recognition and analysis algorithms to convert the motion information into control signals. The generative artificial intelligence system combines these signals to generate personalized interactive experience scenes and interactive game modes. For example, when a user plays a somatosensory football game, the system simulates the movement trajectory of the football and the player's action effects based on the user's movements, achieving natural, smooth and immersive interaction between the user and the projected content.

[0040] Interaction between voice and generative AI: Users can also interact with the generative AI system in the host through voice commands, such as saying "generate a picture book about a forest adventure, with a little monkey as the protagonist". The system quickly mobilizes its powerful natural language processing capabilities and rich creative generation capabilities to analyze the command content, extract relevant information from the knowledge reserve, and use deep learning algorithms to generate corresponding picture book content. The generated picture book is displayed through a projector (16), and background music and narration can be added in conjunction with the sound system, bringing users a new creative inspiration and entertainment experience.

[0041] Interaction with the Gaopaiyi (3): When using the Gaopaiyi (3), the user places the paper pattern to be scanned in the shooting box inside the chassis, and uses the voice command "scan pattern" or clicks the scan button on the touch screen. The Gaopaiyi (3) completes the scanning at a fast scanning speed and high resolution, and converts the paper document image into a digital image. The generative artificial intelligence system conducts in-depth analysis and intelligent processing of the scanned paper document image, not only accurately converting it into an interactive pattern, but also further expanding and generating rich related extended content, such as background stories, knowledge explanations, etc. Users can interact with these interactive patterns by touching the capacitive touch screen (11) and other methods, such as clicking on the pattern to view the extended content, dragging the pattern to play a jigsaw puzzle, etc.

[0042] Special scenario applications: When the user is in an environment where projection is inconvenient, such as in a small office where the space is too small to project normally, or in outdoor strong light where the projection effect is poor. The user can first connect the all-in-one machine to an external large-screen display through the projection function, which supports a variety of mainstream projection protocols such as Miracast, AirPlay and DLNA. Then, through the voice command "generate a beautiful starry sky map", the generative artificial intelligence system quickly generates an image and projects the image onto the large-screen display through the wireless projection module. If the user wants to play a somatosensory game, even if projection is not possible at this time, the motion capture camera (2) can still capture the action, and the host intelligent core computing unit (4) will run the somatosensory game content based on motion recognition on the large-screen display through the projection function and realize interaction, making full use of the device's functions.

Claims

1. An artificial intelligence interactive projection all-in-one machine, characterized in that: It includes an electric lifting case, a mobile chassis and a fixed case; the all-in-one machine is made of metal material, and the user can control it through voice commands or a capacitive touch screen. The control includes device startup, mobile chassis to adjust the projection image, projection angle and height adjustment, and interactive function operation; the all-in-one machine integrates a generative artificial intelligence system, and the generative artificial intelligence system relies on semantic understanding and content generation capabilities to generate relevant content according to user instructions and provide a personalized service experience.

2. The artificial intelligence interactive projection integrated machine according to claim 1, characterized in that: The electric lift box is equipped with a structure that can flexibly change the projection angle. The structure is provided with a projection structure that can be flipped up and down. Through a motor and a mechanical mechanism, the projection structure can be quickly flipped between 0 degrees and 90 degrees to achieve the function of projecting onto a wall or vertically projecting onto the ground.

3. The artificial intelligence interactive projection integrated machine according to claim 1, characterized in that: The electric lift box is provided with a lifting motor for adjusting the projection height and a slide rail auxiliary operation device, so as to ensure the smooth lifting operation of the electric lift box.

4. The artificial intelligence interactive projection integrated machine according to claim 1, characterized in that: The mobile chassis consists of two electric wheels in the middle and four universal wheels at the four corners; the electric wheels are driven by high-torque DC motors to provide the main driving force for movement; the universal wheels at the four corners enhance the flexibility of the equipment and the convenience of steering; the mobile chassis also includes a TOF radar; the TOF radar collects space information below in real time; the generative artificial intelligence system deeply integrates TOF radar information, uses algorithms, and automatically controls the moving direction and distance of the mobile chassis according to the offset, distortion and environmental space changes of the projection picture, and accurately adjusts the projection picture to ensure that the projection picture is always complete, clear and in the best display state; when projecting on the ground, the generative artificial intelligence system calls the TOF radar to sense the contact between the user's legs and the ground projection picture to achieve interaction.

5. The artificial intelligence interactive projection integrated machine according to claim 1, characterized in that: The fixed chassis integrates a motion capture camera, a capacitive touch screen, a high-speed scanner, a wireless screen projection module, a voice recognition module, a speaker, and a host intelligent core computing unit; the motion capture camera has a high frame rate and excellent resolution; the capacitive touch screen has extremely high touch sensitivity; the high-speed scanner has a fast scanning speed and high resolution; The omnidirectional array microphone has high sensitivity and strong noise reduction capability; the speaker adopts a professional-grade audio unit; the host intelligent core computing unit integrates a generative artificial intelligence system based on a deep learning architecture, and the generative artificial intelligence system has the following functions: Content generation: Based on the user's voice commands, the system generates picture books with rich content and vivid plots, as well as challenging and interesting interactive games, etc. by leveraging natural language processing capabilities and creative generation capabilities. The system uses a pre-trained language model based on the Transformer architecture to understand the semantics and grammatical structure of natural language by learning from a large amount of text data, and generates corresponding content according to user commands. Document processing: In-depth analysis and intelligent processing of paper document images scanned by the high-speed scanner are carried out to accurately convert text into interactive patterns, and further expand and generate rich related extended content, such as background stories, knowledge explanations, etc. Use optical character recognition (OCR) technology to convert text in document images into editable text, and then combine it with natural language processing technology to analyze and understand the text and generate relevant extended content; Motion interaction: Combined with the user motion data collected by the motion capture camera, the motion recognition and analysis algorithms are used to generate highly personalized interactive experience scenes and interactive game modes, so as to achieve natural, smooth and immersive interaction between users and projected content. The motion recognition algorithm based on Hidden Markov Model (HMM) and deep learning is used to extract features and match patterns of motion data, identify the user's motion intention, and thus generate corresponding interactive scenes and game modes. Ground interaction and screen adjustment: The TOF radar data of the mobile chassis is used to sense the contact between the user's legs and the projected screen when projecting on the ground. At the same time, according to environmental changes, the image analysis and processing algorithm is used to analyze and adjust the projected screen to realize interactive games based on leg movements. Face recognition: The motion capture camera has a face recognition function. It can quickly and accurately capture and identify the user's facial features through the built-in high-precision image sensor and face recognition algorithm. It uses a face recognition algorithm based on a convolutional neural network, such as FaceNet, to extract the feature vector of the face by learning a large number of face images, and compare and identify it with the face data preset in the system. When the user approaches the device, it automatically identifies the user's identity, extracts usage habits and preference information from the user's historical usage data, and automatically adjusts the projection settings. In interactive scenarios that require identity authentication, face recognition is used as a safe and convenient verification method, and only authorized users can perform related operations. Wireless screen projection: The wireless screen projection module supports multiple mainstream screen projection protocols, such as Miracast, AirPlay and DLNA, etc. It establishes connections with external devices through Wi-Fi networks and uses corresponding screen projection protocols for data transmission, making it convenient for users to project device content to external large-screen displays and expand usage scenarios.

Images