AR intelligent handheld device

Abstract

The utility model provides an AR intelligent hand-held device. The AR intelligent hand-held device comprises a data processing module used for data analysis and identification of a user usage scene; the data acquisition device is used for transmitting acquired data to the data processing module, and the acquired data comprises images and videos of a scene where a user is located or user voice data; the display screen is used for displaying a data processing result of the data processing module; the positioning module is used for positioning the position and the direction of the AR intelligent handheld equipment in the three-dimensional space and transmitting a positioning result to the data processing module; the interaction control module is used for controlling the content displayed on the display screen to realize interaction with a user; wherein the data processing module, the data acquisition device, the display screen, the positioning module and the interaction control module are integrated in a portable handheld device. The system can improve a real-time scene recognition function, has an AR interaction function, is convenient to carry, and greatly improves the use experience of a user.

Description

Technical Field

[0001] The utility model belongs to the technical field of AR equipment, and in particular relates to an AR intelligent handheld device. Background Art

[0002] Traditional AR devices have limitations in scene recognition and interaction, and are unable to achieve fast and accurate scene recognition and interaction with scenes. Utility Model Content

[0003] The utility model provides an AR smart handheld device, which can improve the real-time scene recognition function, has an AR interactive function, is easy to carry, and greatly improves the user experience.

[0004] In a first aspect, an AR smart handheld device is provided, comprising:

[0005] Data processing module for data analysis;

[0006] a data acquisition device for transmitting the collected data to the data processing module, the data acquisition device being connected to the data processing module;

[0007] a display screen for presenting data processing results of the data processing module, wherein the display screen is connected to the data processing module;

[0008] A positioning module for locating the position and direction of the AR smart handheld device in three-dimensional space and transmitting the positioning result to the data processing module, wherein the positioning module is connected to the data processing module;

[0009] An interactive control module for controlling the content presented on the display screen, wherein the interactive control module is connected to the display screen, the data acquisition device and the data processing module.

[0010] Optionally, the positioning module includes: a global positioning unit and an inertial measurement unit.

[0011] Optionally, the data processing module includes:

[0012] an image recognition unit for recognizing image data collected by the data collection device;

[0013] A scenario matching unit for identifying user usage scenarios and matching corresponding simulation scenarios from a database;

[0014] a speech recognition unit for recognizing the speech data collected by the data collection device;

[0015] An AR content generation unit for performing virtual information rendering and light effect simulation to generate simulated scenes;

[0016] The image recognition unit, the scene matching unit and the voice recognition unit are connected to the AR content generation unit.

[0017] Optionally, the interaction control module includes:

[0018] a button unit for displaying interactive option buttons on the display screen;

[0019] Special effects display unit for displaying interactive special effects;

[0020] Wherein, the button unit is connected to the special effect display unit.

[0021] Optionally, the data acquisition device includes: a video acquisition device and a voice acquisition device;

[0022] The video acquisition device includes but is not limited to: a network camera or a USB camera; the voice acquisition device includes but is not limited to: a microphone or a sound card.

[0023] The present invention provides an AR smart handheld device with the following advantages:

[0024] 1. This utility model has advanced real-time scene recognition technology, which can quickly and accurately identify the surrounding environment and provide relevant information and interaction.

[0025] 2. The present invention can generate realistic augmented reality (AR) scenes and interact with users; users can interact with virtual objects in real time through operations on handheld devices.

[0026] 3. This utility model adopts a lightweight and portable design, which is convenient for users to carry and operate.

[0027] It should be understood that the contents described in the summary of the utility model are not intended to limit the key or important features of the embodiments of the utility model, nor are they intended to limit the scope of the utility model. Other features of the utility model will become easier to understand through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] In order to more clearly illustrate one or more embodiments of this specification or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments recorded in this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0029] Figure 1This is a schematic diagram showing the connections of the functional modules of an AR smart handheld device according to an embodiment of the present invention;

[0030] Figure 2 This is a schematic diagram of the connection of various functional modules of another AR smart handheld device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0031] In order to enable those skilled in the art to better understand the technical solutions in one or more embodiments of this specification, the technical solutions in one or more embodiments of this specification will be clearly and completely described below in conjunction with the drawings in one or more embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this specification, not all of the embodiments. Based on one or more embodiments of this specification, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of this document.

[0032] The present invention will be further described below with reference to the accompanying drawings and specific embodiments:

[0033] Figure 1 This is a schematic diagram of the connection of the functional modules of an AR smart handheld device according to an embodiment of the present invention. Figure 1 Shown:

[0034] AR smart handheld devices include:

[0035] Data processing module for data analysis;

[0036] A data acquisition device for transmitting the collected data to the data processing module, the data acquisition device being connected to the data processing module;

[0037] A display screen for presenting the data processing results of the data processing module, the display screen being connected to the data processing module;

[0038] A positioning module for locating the position and direction of the AR smart handheld device in three-dimensional space and transmitting the positioning result to the data processing module, the positioning module is connected to the data processing module;

[0039] An interactive control module is used to control the content presented on the display screen, and the interactive control module is connected to the display screen, the data acquisition device and the data processing module.

[0040] In this embodiment, the interactive control module is connected to the data acquisition device and the data processing module. When the user triggers the interactive function of the AR smart handheld device, the interactive control module sends instructions to the data acquisition device to collect the user's interactive instructions; the interactive instructions include: gestures or voice; the data processing module receives and analyzes the interactive instructions, and sends the analysis results to the interactive control module; the interactive control module matches the corresponding interactive mode according to the analysis results to interact with the user in AR.

[0041] Figure 2 This is a schematic diagram showing the connection of various functional modules of another AR smart handheld device according to an embodiment of the present invention. Figure 2 Shown:

[0042] The positioning module includes: a global positioning unit and an inertial measurement unit.

[0043] The data processing module includes:

[0044] an image recognition unit for recognizing image data collected by the data collection device;

[0045] A scenario matching unit for identifying user usage scenarios and matching corresponding simulation scenarios from a database;

[0046] a speech recognition unit for recognizing speech data collected by the data collection device;

[0047] An AR content generation unit for performing virtual information rendering and light effect simulation to generate simulated scenes;

[0048] Among them, the image recognition unit, scene matching unit and voice recognition unit are connected to the AR content generation unit.

[0049] The interactive control module includes:

[0050] A button unit for displaying interactive option buttons on a display screen;

[0051] Special effects display unit for displaying interactive special effects;

[0052] Among them, the button unit is connected to the special effect display unit.

[0053] The data acquisition device includes: a video acquisition device and a voice acquisition device;

[0054] Video acquisition devices include but are not limited to: a webcam or a USB camera; voice acquisition devices include but are not limited to: a microphone or a sound card.

[0055] In this embodiment, the image recognition unit uses advanced computer vision algorithms to quickly and accurately identify scene images captured in real time, so as to identify image features that match predefined scenes and quickly match predefined scenes; the scene matching unit uses an efficient scene matching algorithm to match the identified scene features with a pre-established scene database, thereby determining the scene's identification and attribute information to quickly match the scene; the AR content generation unit can use augmented reality technology on the basis of image recognition, voice recognition and scene matching to superimpose relevant AR content on the identified scene and perform virtual information rendering and light effect simulation.

[0056] In this embodiment, after the interactive control module receives the analysis results of the interactive instruction, the button unit can also display the function selection button on the display screen. When the user selects the button option, the button unit communicates with the special effect display unit, and calls the interactive special effect corresponding to the button from the special effect display unit to display it on the display screen.

[0057] The present invention provides an AR smart handheld device, which includes: a data processing module for data analysis; a data acquisition device for transmitting collected data to the data processing module, the data acquisition device being connected to the data processing module; a display screen for presenting the data processing results of the data processing module, the display screen being connected to the data processing module; a positioning module for locating the position and orientation of the AR smart handheld device in three-dimensional space and transmitting the positioning results to the data processing module, the positioning module being connected to the data processing module; and an interactive control module for controlling the content presented on the display screen, the interactive control module being connected to the display screen, the data acquisition device, and the data processing module. The present invention can improve real-time scene recognition capabilities, has AR interactive functions, is easy to carry, and greatly enhances the user experience.

[0058] Although the embodiments of the present invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and variations may be made to these embodiments without departing from the principles and spirit of the present invention, and the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. An AR smart handheld device, characterized in that: The AR smart handheld device includes: Data processing module for data analysis; A data acquisition device for transmitting the collected data to the data processing module, wherein the data acquisition device is connected to the data processing module; A display screen for presenting the data processing results of the data processing module, wherein the display screen is connected to the data processing module; A positioning module for locating the position and direction of the AR smart handheld device in three-dimensional space and transmitting the positioning result to the data processing module, wherein the positioning module is connected to the data processing module; An interactive control module for controlling the content presented on the display screen, the interactive control module being connected to the display screen, the data acquisition device and the data processing module; The data processing module comprises: An image recognition unit for recognizing image data collected by the data collection device; A scenario matching unit for identifying user usage scenarios and matching corresponding simulation scenarios from a database; A speech recognition unit for recognizing the speech data collected by the data collection device; An AR content generation unit for performing virtual information rendering and light effect simulation to generate a simulated scene; Wherein, the image recognition unit, the scene matching unit and the voice recognition unit are connected to the AR content generation unit; The interactive control module comprises: A button unit for displaying interactive option buttons on the display screen; Special effects display unit for displaying interactive special effects; Wherein, the button unit is connected to the special effect display unit.

2. The AR smart handheld device according to claim 1, characterized in that: The positioning module includes: a global positioning unit and an inertial measurement unit.

3. The AR smart handheld device according to claim 1, characterized in that: The data acquisition device includes: a video acquisition device and a voice acquisition device; The video acquisition device is a network camera or a USB camera; the voice acquisition device is a microphone or a sound card.

Images