Modular Augmented Reality System for Portable Gaming Consoles

Abstract

The invention relates to a modular augmented reality system that can be integrated into a portable game console or used as a detachable unit, providing three-dimensional environmental perception, depth measurement, and real-time interaction.

Description

1 TARIFF Modular Augmented Reality System for Portable Gaming Consoles Technical Area 5 The invention is a device that can be integrated into a portable game console or used as a detachable unit. Modular system providing three-dimensional environment perception, depth measurement and real-time interaction. It is related to augmented reality systems. State of the Art Today's portable game consoles mostly offer the user a two-dimensional (flat-screen) 10-inch screen. They have been developed as systems that offer a gaming experience. The hardware found in these devices... They are generally limited to classic control inputs (keys, analog sticks), but some advanced ones... The models also include sensors such as accelerometers, gyroscopes, or basic camera systems. However, these sensors enable the perception of the environment in three dimensions. 15 advanced features such as depth information extraction and real-time environmental mapping sufficient technical capacity for augmented reality (AR) applications It is unable to provide this. Smartphones and tablets, where augmented reality technologies are widely used. In mobile devices, this is especially true for LiDAR (Light Detection and Ranging) or ToF (Time of Failure) devices. Thanks to the (flight) sensors, three-dimensional mapping of the environment and accurate object depth are possible. This has made it possible to perceive and detect surfaces in this way. Such solutions are implemented through software. supported by platforms that provide highly accurate and stable AR experiences. It allows for its development. In current systems, there are either externally attachable and detachable devices or devices that work integrated with the device. A depth camera solution is not available. This deficiency is addressed in the console-based AR 25. This limits the development of applications and negatively impacts user experience. In this context, the current technical situation includes the following main problems:  Due to the inability to map the game environment in three dimensions, it is done at the room scale. AR experiences remain limited,  As a result of the inability to accurately perceive the depth and distance information of objects 30 The emergence of superficial and unrealistic AR applications, 2  Real-time AR due to stabilization and position tracking deficiencies Delays, deviations, and errors occur in their interactions. Application number US7758424B2 concerns a different type of handheld game controller. User input via modular input units that can be attached and detached from various locations. It is related to the system that enables its detection and recognition by the device. However The application includes three-dimensional environmental sensing, depth measurement, and real-time interaction. The modular augmented reality system that provides this functionality is not included. In conclusion, due to the negative aspects described above and the current solutions, topic 10 Due to its shortcomings, an improvement is needed in the relevant technical field. It has been observed. Purpose of the Invention The main purpose of the invention is to bring augmented reality (AR) to portable handheld game consoles. a modular system that will enable, improve and make their experiences more stable The aim is to provide a hardware structure. In this context, the invention is a device that can be integrated into or plugged into a console. Through an AR unit that can be used detached from the device, three-dimensional environmental perception and depth perception are possible. It provides measurement and real-time interaction. The invention enables real-time and high-accuracy augmented reality on handheld consoles. It provides an experience. In current technology, handheld consoles only offer on-screen visual presentation. While initially limited, this invention transforms the device into an intelligent gaming platform that senses its surroundings. The invention works by operating as an integrated system, realizing the physical environment in which the console is located. It enables the creation of a three-dimensional map in real time and with high accuracy. 25 The system uses Simultaneous Localization and Mapping algorithms to determine location. It performs identification and mapping operations simultaneously. Another aim of the invention is accurate depth perception, even in low light or dark environments. The goal is to enhance the continuity and reliability of AR experiences by providing a structure that can do this. Depth measurement, supported by an IR projector, remains stable under different environmental conditions. It contributes to achieving performance. Furthermore, the invention enables precise acquisition of motion and orientation information of the console via the IMU sensor. by enabling augmented reality content to be viewed in a way that is compatible with the physical world. 3 and ensures it remains stable. This prevents problems such as delay, slippage, and vibration. The aim is to minimize it. Another objective of the invention is to securely and vibration-free attach the module to the console using the mounting bracket. by ensuring it is not mounted in a way that could negatively impact the user experience The aim is to prevent mechanical instabilities. Thanks to the Type-C port, both data 5 By enabling both communication and power transmission, the system operates in a practical and harmonious manner. is provided. The structural and characteristic features and all the advantages of the invention are given in the figures below. This becomes clearer thanks to the detailed explanation written with references to these figures. It will be understood. 10 Explanation of the Figures Figure 1 is a representative view of the internal structure of the invention. Figure 2 shows the integration of the system described in the invention into the handheld console. The drawings do not necessarily need to be scaled, and 15 lines are sufficient to understand the invention. Unnecessary details may have been omitted. Explanation of Part References 1. Color sensor 20 2. Depth sensor 3. Projector 4. Unit of measurement 5. Fixing bracket 6. Port 25 7. Processor unit Detailed Description of the Invention In this detailed explanation, the preferred configurations of the invention are not merely for better understanding the subject. 30 for the purpose of understanding and without imposing any limiting effect It is explained. 4 The invention is an anti-vibration fixing bracket (5) integrated into a portable game console, It is an augmented reality system with a modular structure that allows the user to adjust their surroundings. color sensor (1) that detects the color image, measures the distance of objects in the environment depth sensor (2) which creates a three-dimensional depth map, depth measurements To increase accuracy, invisible infrared 5 is applied to the surface in low-light environments. projector (3) that reflects patterns, measures changes in the movement and orientation of the console unit of measurement (4), virtual objects in the game at a fixed point in real space To ensure it stops, the data in the measuring unit (4), the color sensor (1) and the depth The processor unit (7) combines the data from the sensor (2) with the power and data transfer. It includes the connection port (6) that provides SLAM algorithms. The processor unit (7) supports SLAM algorithms. using simultaneous location determination and mapping processes It is carrying out. The color sensor (1) detects the color image of the environment. The depth sensor (2), It calculates object distances by creating a depth map. Projector (3), low 15 It supports depth measurement in light. The measurement unit (4) measures motion and orientation. It makes virtual objects appear fixed. The fixing unit (5) is the subject of the invention. It fixes the system to the console and prevents vibration. Connection port (6), power and data It enables the transfer. In a preferred configuration of the invention, the connection point (6) It is Type-C. The processor unit (7) processes all data from the sensors and SLAM 20 It runs Simultaneous Localization and Mapping algorithms. The color sensor (1) takes a color image of the environment where the user is located. Simultaneously As a depth sensor (2), it measures the distance of objects in the environment, thus creating a three-dimensional image. It creates a depth map. The accuracy of these depth measurements is determined by the projector (3). This is enhanced by invisible infrared patterns projected onto the surface in low-light environments. 25 This ensures that the invention functions stably not only in bright environments but also under various conditions. is provided. Changes in the movement and orientation of the console are continuously measured by the unit of measurement (4). This data is measured with data from the color sensor (1) and the depth sensor (2). By combining them, the virtual objects in the game remain fixed at a single point in real space. 30 This is ensured. For example, when the player moves the console left or right, the virtual object on the screen changes. It continues to appear as if it is in the same place. All of this data is in the processor unit (7) It is processed and data communication and power exchange is made with the device via the connection point (6). The invention is securely integrated into the console thanks to the fixing bracket (5). The anti-vibration structure used in the fixing bracket (5) is protected even during sudden movements while playing. It prevents image distortion or errors.

Claims

6 REQUESTS 1. Integrated into the portable game console with an anti-vibration fixing bracket (5), It is an augmented reality system with a modular structure; its feature is:  color sensor (1) that detects the color image of the environment in which the user is located, 5  Creating a three-dimensional depth map by measuring the distance of objects in the environment depth sensor (2),  To improve the accuracy of depth measurements in low-light environments projector (3) that projects invisible infrared patterns onto the surface,  Unit of measurement that measures changes in the movement and orientation of the console (4), 10  virtual objects within the game remain stationary at a fixed point in real space In order to provide the data in the measuring unit (4), the color sensor (1) and the depth The processor unit (7) combines the data from the sensor (2),  It includes a connection point (6) that provides power and data transfer.

2. It is an augmented reality system according to claim 1, and its feature is; SLAM algorithms. using simultaneous location determination and mapping processes It includes the processor unit (7) that performs the operation.

Images