Entertainment deduction experience method based on mobile live-action cognition
By measuring and refreshing the transmission efficiency of the Bluetooth channel between the intelligent camera and the AR information display system, and managing the refresh of the Bluetooth network smart camera through the management and control module, the problem of insufficient transmission efficiency of a single Bluetooth channel is solved, and efficient, precise transmission and synchronization of real-life images of the road are achieved.
Patent Information
- Application Number
- CN202411744293.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-30
- Publication Date
- 2025-03-04
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
In the prior art, when the intelligent camera transmits real-life images of the road to the AR information display system, the transmission efficiency of a single Bluetooth channel is insufficient, and the Bluetooth transmission efficiency is easily affected by distance and external magnetic field interference, resulting in unstable transmission efficiency.
Through the process of detecting and transmitting real-life images on the road, performing the effectiveness measurement and response refresh of the Bluetooth network transmission channel, and the control and control module manages the refresh of the Bluetooth network intelligent camera to ensure efficient and accurate transmission of real-life images on the road.
It realizes efficient and accurate transmission of real-life images on the road, ensures complete and synchronous images, and maintains efficient transmission under poor Bluetooth network conditions, improving the efficiency of Bluetooth network transmission channels.
Smart Images

Figure CN119562044A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of mobile real-scene cognition, and in particular relates to a method for entertainment interpretation experience based on mobile real-scene cognition. Background Art
[0002] With the rapid development of information technology, mobile scene recognition, as an emerging technical means, has shown its unique advantages and application prospects in several fields. Mobile scene recognition technology presents the real world in a digital form through high-precision modeling and rendering, providing a new perspective and solutions for many industries.
[0003] As for the entertainment experience based on mobile real-scene cognition, it is currently often necessary to implement the solution mentioned in the patent publication number "CN116630577A". Specifically, the head-up display and AR information display system on the vehicle are electrically connected, and the AR information display system and the smart camera are connected via Bluetooth network. The smart camera is used to sample the real-scene image of the road when the vehicle is working and transmit it to the AR information display system. The AR information display system is used to determine the predicted display position of the corresponding AR information based on the collected real-scene image of the road, and finally control the head-up display to display AR information to enhance the user experience.
[0004] When the smart camera transmits the real-scene image of the road to the AR information display system, the smart camera has a large demand for the interaction of the real-scene image of the road on the Bluetooth network. The transmission efficiency of a single Bluetooth channel cannot meet its own requirements. Therefore, a smart camera with several Bluetooth channels for communication can be used to combine the transmission efficiency sources of several Bluetooth channels to improve the transmission interaction of the real-scene image of the road. However, due to the limitation of the Bluetooth transmission length, if the distance between the smart camera and the AR information is not small, the Bluetooth transmission efficiency will be weakened. In addition, the Bluetooth transmission efficiency is often weakened by the interference of external magnetic fields and other factors, resulting in different and constantly changing transmission efficiency of each Bluetooth channel, thereby weakening the transmission efficiency of all Bluetooth channels. Summary of the invention
[0005] In order to solve the defects in the prior art, the present invention provides a method for entertainment interpretation experience based on mobile real-scene cognition, which detects the real-scene image of the road and transmits it to the AR information display system for processing; performs performance measurement and response update processing of the Bluetooth network transmission channel; performs control and analysis on the transmission of the real-scene image of the road; a control module is used to control the update of the smart camera of the Bluetooth network; it can effectively ensure the transmission efficiency and accuracy of the real-scene image of the road, maximize the complete synchronization of the real-scene image of the road, and can preferentially perform the transmission of the real-scene image on the channel with better performance measurement, so that it can still achieve the guarantee of the transmission efficiency of the real-scene image of the road under poor Bluetooth network conditions, and can then update the restoration status of the Bluetooth network transmission channel when it is not suitable for reasonable real-scene image transmission, effectively improving the utilization efficiency of the Bluetooth network transmission channel, and partially improving the transmission efficiency of the real-scene image of the road.
[0006] The present invention uses the following technical solutions.
[0007] A method for entertainment interpretation experience based on mobile real-scene cognition, comprising:
[0008] The smart camera samples the real-life road image when the vehicle is working and transmits it to the AR information display system. The AR information display system determines the predicted display position of the corresponding AR information based on the collected real-life road image, and finally controls the head-up display to display the AR information, thereby improving the user experience.
[0009] The method for transmitting a road real scene image to an AR information display system by an intelligent camera includes:
[0010] Step 1: Detect the real road scene image and transmit it to the AR information display system for processing;
[0011] Furthermore, in step 1, after executing the road real scene image detection, communication with the AR information display system is completed and the road real scene image is transmitted to the AR information display system for processing.
[0012] Furthermore, in step 1, the detection and listening of the real road scene images is performed using an iterative polling listening method according to the defined timing period, and when the detection and listening period is not executed at a time point, after the total capacity of the real road scene images to be transmitted reaches the defined capacity critical amount, the detection and listening of the real road scene images can be activated immediately to prevent the situation where the real road scene images accumulate rapidly due to the failure to reach the defined timing period.
[0013] Furthermore, in step 1, after the detection and monitoring is completed, a unique authentication code is generated for each detected road real scene image, so that each road real scene image forms a numerical mark in the smart camera, and the control transmits the numerical mark to the AR information display system when the road real scene image is transmitted to the AR information display system. After receiving the road real scene image, the AR information display system uses the same mark processing to compare the obtained numerical mark with the transmitted numerical mark. If the two marks are the same, they are the same value. Otherwise, it means that an error occurred in the transmission of the road real scene image.
[0014] Step 2: Perform Bluetooth network transmission channel function measurement and response update processing;
[0015] Furthermore, in step 2, before channel configuration, the transmission efficiency of the current Bluetooth network is measured. When the transmission channel of the Bluetooth network whose measured efficiency is less than a critical value temporarily interrupts the transmission of the real road scene image, the channel with the best measured efficiency is selected to perform the transmission of the real road scene image.
[0016] Furthermore, in step 2, after temporarily interrupting the transmission of the road real scene image when the Bluetooth network transmission channel has a measured efficiency less than a critical amount, it is controlled to transmit a backup of the reasonable road real scene image to the AR information display system.
[0017] Step 3: Perform control analysis on the transmission of the road real scene image;
[0018] Furthermore, in step 3, the real-scene image of the road transmitted to the AR information display system is collected, and retransmission and storage control can be performed; after receiving the real-scene image of the road from the smart camera, it can be controlled to store the collected real-scene image of the road in the information table of the AR information display system, which is used for the real-scene image transmission of the AR information display system, and can then be used for the AR information display system to face the set real-scene image of the road.
[0019] Further, in step 3, after obtaining the real-scene image of the road to be transmitted, the transmission processing of the real-scene image of the road is performed according to the number of smart cameras on the chain; after completing the parsing configuration of the set configuration document, the real-scene image of the road to be transmitted is obtained and according to the number of smart cameras on the chain, the transmitter and receiver of the transmission service of the corresponding smart camera are constructed, and after the transmitter and receiver of the transmission are initialized, the transmission service is centrally controlled through the main program. Here, after the smart camera is started, the service is obtained through the information table at a regular interval, and the service arrangement and transmission are performed according to the configured transmission rules. The service message is synchronously transmitted to the AR information display system, and the service message will be waited for after work. After obtaining new service, it starts to listen to whether the Bluetooth network is connected. If it is connected, the actual transmission service is started. Otherwise, it will wait for a period of time before transmitting again. After the transmission is completed, if the smart camera does not detect the new service, the service cancellation message is transmitted to destroy the started transmission service.
[0020] Furthermore, in step 3, the information table is used to store the real-scene image of the Bluetooth network road, and the backup is performed on a pair of AR information display systems, and a synchronization method is configured between a pair of information tables to perform the backup.
[0021] Step 4: Control the refresh of the smart camera on the Bluetooth network.
[0022] Further, in step 4, the AR information display system generates a patch when the smart camera executes the refresh, and synchronously executes the patch transmission. If the patch is valid and the refresh condition permits, the patch is executed. If the patch is not successful, the patch is executed again after a period of time. After the patch fails to reach the set frequency, the patch is determined to be wrong, and the patch is synchronously deleted from the folder to ensure the reasonable execution of the refresh;
[0023] The road real-scene image transmission of the Bluetooth network transmission channel is implemented in a distributed storage manner, so that each participating network element can independently and completely store the road real-scene image in the corresponding space. When the transmitted road real-scene image is lost or modified, the restored control can be performed based on the stored road real-scene image.
[0024] A device for entertainment interpretation experience based on mobile real-scene cognition, comprising:
[0025] The head-up display provided on the vehicle is electrically connected to the AR information display system, and the AR information display system is connected to the smart camera via Bluetooth network. The smart camera is used to sample the real road scene image when the vehicle is working and transmit it to the AR information display system. The AR information display system is used to determine the predicted display position of the corresponding AR information based on the collected real road scene image, and finally control the head-up display to display the AR information to improve the user experience;
[0026] The devices for entertainment experience based on mobile real scene recognition also include:
[0027] A processing module, which is used to detect the real road scene image and transmit it to the AR information display system for processing;
[0028] A refresh module, which is used to perform function measurement and response refresh processing of Bluetooth network transmission channels;
[0029] An analysis module, which is used to perform control and management analysis on the transmission of the road real scene image;
[0030] The control module is used to control the refresh execution of the smart camera of the Bluetooth network.
[0031] The beneficial effect of the present invention lies in that, compared with the prior art, the present invention can effectively ensure the transmission efficiency and accuracy of the road real scene image, maximize the complete synchronization of the road real scene image, and can preferentially use the channel with better performance measurement to perform the road real scene image transmission, so that it can still achieve the guarantee of the road real scene image transmission efficiency under poor Bluetooth network conditions, and can then update the restoration status of the Bluetooth network transmission channel when it is not suitable for reasonable road real scene image transmission, effectively improving the utilization efficiency of the Bluetooth network transmission channel, and partially improving the transmission efficiency of the road real scene image. BRIEF DESCRIPTION OF THE DRAWINGS
[0032] Figure 1 It is a partial flow chart of the method for entertainment interpretation experience based on mobile real scene cognition described in the present invention;
[0033] Figure 2 It is a schematic diagram of the module structure of the device for entertainment interpretation experience based on mobile real-scene cognition described in the present invention. DETAILED DESCRIPTION
[0034] When the smart camera transmits the real-scene image of the road to the AR information display system, the smart camera has a large demand for the interaction of the real-scene image of the road on the Bluetooth network. At present, the transmission efficiency of a single Bluetooth channel cannot meet its own requirements. Therefore, a smart camera with several Bluetooth channels for communication can be used to combine the transmission efficiency sources of several Bluetooth channels to improve the transmission interaction of the real-scene image of the road. However, due to the limitation of the Bluetooth transmission length, if the distance between the smart camera and the AR information is not small, the Bluetooth transmission efficiency will be weakened. In addition, the Bluetooth transmission efficiency is often weakened by the interference of external magnetic fields and other factors, resulting in different and constantly changing transmission efficiency of each Bluetooth channel, thereby weakening the transmission efficiency of all Bluetooth channels.
[0035] The present invention detects the real-scene image of the road and transmits it to the AR information display system for processing; performs performance measurement and response update processing of the Bluetooth network transmission channel; performs control management and analysis on the transmission of the real-scene image of the road; a control module is used to control the update of the smart camera of the Bluetooth network; it can effectively ensure the transmission efficiency and accuracy of the real-scene image of the road, maximize the complete synchronization of the real-scene image of the road, and can preferentially perform the transmission of the real-scene image of the road through a channel with better performance measurement, so that it can still achieve the guarantee of the transmission efficiency of the real-scene image of the road under poor Bluetooth network conditions, and can then update the restoration status of the Bluetooth network transmission channel when it is not suitable for reasonable real-scene image transmission, effectively improving the utilization efficiency of the Bluetooth network transmission channel, and partially improving the transmission efficiency of the real-scene image of the road.
[0036] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely expressed in combination with the drawings in the embodiments of the present invention. The embodiments expressed in this application are only embodiments of a part of the present invention, not all embodiments. According to the spirit of the present invention, other embodiments obtained by ordinary technicians in this field without creative work are all within the scope of protection of the present invention.
[0037] like Figure 1 As shown, the method of entertainment interpretation experience based on mobile real scene cognition described in the present invention includes:
[0038] The smart camera samples the real-life road image when the vehicle is working and transmits it to the AR information display system. The AR information display system determines the predicted display position of the corresponding AR information based on the collected real-life road image, and finally controls the head-up display to display the AR information, thereby improving the user experience.
[0039] The method for transmitting a road real scene image to an AR information display system by an intelligent camera includes:
[0040] Step 1: Detect the real road scene image and transmit it to the AR information display system for processing;
[0041] In a preferred but non-limiting embodiment of the present invention, in step 1, after performing road real scene image detection, communication with the AR information display system is achieved and the road real scene image is transmitted to the AR information display system for processing.
[0042] In a preferred but non-restrictive implementation of the present invention, in step 1, the detection and listening of the real road scene images is performed using an iterative polling listening method according to a defined timing period, and when the detection and listening period is not executed at a time point, after the total capacity of the real road scene images to be transmitted reaches a defined capacity critical amount, the detection and listening of the real road scene images can be activated immediately to prevent the situation where the real road scene images accumulate rapidly due to the failure to reach the defined timing period.
[0043] In a preferred but non-restrictive embodiment of the present invention, in step 1, after the detection and monitoring is completed, a unique authentication code is generated for each detected road real scene image, so that each road real scene image generates a numerical mark in the smart camera, and the control is used to transmit the numerical mark to the AR information display system when the road real scene image is transmitted to the AR information display system. After receiving the road real scene image, the AR information display system uses the same mark processing to compare the obtained numerical mark with the transmitted numerical mark. If the two marks are the same, they are the same value. Otherwise, it means that an error occurred in the transmission of the road real scene image, and the re-transmission processing needs to be performed. Through this step 1, the transmission efficiency and accuracy of the road real scene image are effectively guaranteed, and the complete synchronization of the road real scene image is well guaranteed.
[0044] Step 2: Perform Bluetooth network transmission channel function measurement and response update processing;
[0045] In a preferred but non-restrictive embodiment of the present invention, in step 2, before executing the configuration of the Bluetooth network transmission channel, the transmission efficiency of the Bluetooth network is measured and processed; because when the Bluetooth network is in poor condition, when the road real scene image transmission on a Bluetooth channel generates a road real scene image message loss, it will cause the road real scene image message disorder, so the road real scene image is retransmitted on another transmission Bluetooth channel, and the lost road real scene image must be transmitted again on the lost channel synchronously, which will weaken the transmission efficiency of the Bluetooth channel. Therefore, through step 2, before the channel is configured, the transmission efficiency of the current Bluetooth network is measured. When the Bluetooth network transmission channel with a measured efficiency less than a critical amount temporarily interrupts the transmission of the road real scene image, the channel with the best measured efficiency is selected to perform the road real scene image transmission, so that the road real scene image transmission efficiency can still be guaranteed under poor Bluetooth network conditions.
[0046] In a preferred but non-restrictive embodiment of the present invention, in step 2, after the effectiveness of the Bluetooth network transmission channel is measured, a response refresh process is performed on the Bluetooth network channel that interrupts the transmission of the road real scene image; in step 2, after the Bluetooth network transmission channel whose measured effectiveness is less than the critical value temporarily interrupts the transmission of the road real scene image, it is controlled to transmit a backup of the valid road real scene image to the AR information display system, so that it can then refresh the restoration status of the Bluetooth network transmission channel without affecting the transmission of the valid road real scene image, thereby effectively improving the utilization efficiency of the Bluetooth network transmission channel and significantly improving the transmission efficiency of the road real scene image.
[0047] Step 3: Perform control analysis on the transmission of the road real scene image;
[0048] In a preferred but non-restrictive embodiment of the present invention, in step 3, the real-scene image of the road transmitted to the AR information display system is collected, and retransmission and storage control can be performed; in step 3, after the real-scene image of the road is collected from the smart camera, it can be controlled to store the collected real-scene image of the road in the information table of the AR information display system, which is used for the real-scene image transmission of the AR information display system, and can then be used for the AR information display system to face the set real-scene image of the road. Due to the need to transmit again for any reason, the transmission is started again by transmitting the set real-scene image of the road to the AR information display system, and the transmission status of the real-scene image of the road can be retrieved by transmitting the set retrieved real-scene image of the road to the AR information display system at the same time. By obtaining step 3, the transmission of the real-scene image of the road can be made more efficient and stable.
[0049] In a preferred but non-restrictive embodiment of the present invention, in step 3, after obtaining the real-scene image of the road to be transmitted, the transmission processing of the real-scene image of the road is performed according to the number of smart cameras on the chain; in step 3, after the parsing configuration of the set configuration document is completed, the real-scene image of the road to be transmitted is obtained and according to the number of smart cameras on the chain, the transmitter and receiver of the transmission service of the corresponding smart camera are constructed, and after the transmitter and receiver of the transmission are initialized, the transmission service is centrally controlled through the main program. Here, after the smart camera is started, the service is obtained through the information table at a regular interval, and the arrangement and transmission of the service are executed according to the configured transmission rules, and the service message is transmitted to the AR information display system synchronously. After the work, it will wait for the receipt of the service message. After obtaining the new service, it starts to listen to whether the Bluetooth network is connected. If it is connected, the actual transmission service is started. Otherwise, it will wait for a period of time and transmit again. After the transmission is completed, if the smart camera does not detect the new service, the service cancellation message is transmitted, the started transmission service is destroyed, and the main memory of the smart camera is reset to ensure the smooth operation of the Bluetooth network.
[0050] In a preferred but non-restrictive embodiment of the present invention, in step 3, an information table is used to store real-scene road images on the Bluetooth network, and backup is performed on a pair of AR information display systems. A pair of information tables are configured to perform backup using a synchronization method. The main information table is mainly used to perform transmission in the face of the real-scene road image transmission business, and the information table is used to back up the real-scene road image and provide retrieval for the real-scene road image.
[0051] Step 4: Control the refresh of the smart camera on the Bluetooth network.
[0052] In a preferred but non-limiting embodiment of the present invention, in step 4, the AR information display system generates a patch when the smart camera executes the refresh, and synchronously executes the patch transmission. If the patch is reasonable and the refresh condition permits, the patch is executed. If the patch is not successful, the patch is executed again after a period of time. After the patch is not successful for a set frequency, the patch is determined to be wrong, and the patch is synchronously cleared from the folder to ensure the reasonable execution of the refresh;
[0053] The road real-scene image transmission of the Bluetooth network transmission channel is implemented in a distributed storage manner, so that each participating network element can independently and completely store the road real-scene image in the corresponding space. When the transmitted road real-scene image is lost or modified, the restored control can be performed based on the stored road real-scene image.
[0054] like Figure 2 As shown, the device for entertainment interpretation experience based on mobile real scene recognition described in the present invention includes:
[0055] The head-up display provided on the vehicle is electrically connected to the AR information display system, and the AR information display system is connected to the smart camera via Bluetooth network. The smart camera is used to sample the real road scene image when the vehicle is working and transmit it to the AR information display system. The AR information display system is used to determine the predicted display position of the corresponding AR information based on the collected real road scene image, and finally control the head-up display to display the AR information to improve the user experience;
[0056] The devices for entertainment experience based on mobile real scene recognition also include:
[0057] A processing module, which is used to detect the real road scene image and transmit it to the AR information display system for processing;
[0058] A refresh module, which is used to perform function measurement and response refresh processing of Bluetooth network transmission channels;
[0059] An analysis module, which is used to perform control and management analysis on the transmission of the road real scene image;
[0060] The control module is used to control the refresh execution of the smart camera of the Bluetooth network.
[0061] The beneficial effect of the present invention lies in that, compared with the prior art, the present invention can effectively ensure the transmission efficiency and accuracy of the road real scene image, maximize the complete synchronization of the road real scene image, and can preferentially use the channel with better performance measurement to perform the road real scene image transmission, so that it can still achieve the guarantee of the road real scene image transmission efficiency under poor Bluetooth network conditions, and can then update the restoration status of the Bluetooth network transmission channel when it is not suitable for reasonable road real scene image transmission, effectively improving the utilization efficiency of the Bluetooth network transmission channel, and partially improving the transmission efficiency of the road real scene image.
[0062] The present disclosure can be a system, a method and / or a computer program product. The computer program product can include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement each aspect of the present disclosure.
[0063] A computer-readable storage medium can be a tangible device that can hold and store instructions for use by an instruction execution device. A computer-readable storage medium can be, but is not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the above. More specific examples (a non-exhaustive list) of computer-readable storage media include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disk read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanical encoding device, such as a punch card or a raised structure in a groove on which instructions are stored, and any suitable combination of the above. The computer-readable storage medium used herein is not to be interpreted as a transient signal itself, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (such as a light pulse through a fiber optic cable), or an electrical signal transmitted through a wire.
[0064] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, optical fiber transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing / processing device.
[0065] The computer program instructions for performing the operations of the present disclosure can be assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages such as Smalltalk, C++, etc., and conventional procedural programming languages such as "C" language or similar programming languages. The computer-readable program instructions can be executed entirely on the controller computer, partially on the controller computer, as a separate software package, partially on the controller computer and partially on a remote computer, or completely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the controller computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (such as connecting through the Internet using an Internet service provider). In some embodiments, each aspect of the present disclosure is implemented by utilizing state information of computer-readable program instructions to personalize an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), which can execute computer-readable program instructions.
[0066] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the above embodiments, ordinary technicians in the relevant field should understand that the specific implementation methods of the present invention can still be modified or replaced by equivalents, and any modifications or equivalent replacements that do not depart from the spirit and scope of the present invention should be covered within the scope of protection of the claims of the present invention.
Claims
1. A method for entertainment interpretation experience based on mobile real-scene cognition, characterized in that: include: The smart camera samples the real-life road image when the vehicle is working and transmits it to the AR information display system. The AR information display system determines the predicted display position of the corresponding AR information based on the collected real-life road image, and finally controls the head-up display to display the AR information, thereby improving the user experience. The method for transmitting a road real scene image to an AR information display system by an intelligent camera includes: Step 1: Detect the real road scene image and transmit it to the AR information display system for processing; Step 2: Perform Bluetooth network transmission channel function measurement and response update processing; Step 3: Perform control analysis on the transmission of the road real scene image; Step 4: Control the refresh of the smart camera on the Bluetooth network.
2. The method for entertainment interpretation experience based on mobile real-scene cognition according to claim 1, characterized in that: In step 1, after performing road real scene image detection, communication with the AR information display system is completed and the road real scene image is transmitted to the AR information display system for processing.
3. The method for entertainment interpretation experience based on mobile real-scene cognition according to claim 2, characterized in that: In step 1, the detection and listening of the real road scene images are performed using the iterative polling listening method according to the defined timing period, and when the detection and listening period is not executed at the time point, after the total capacity of the real road scene images to be transmitted reaches the defined capacity critical amount, the detection and listening of the real road scene images can be activated immediately to prevent the situation where the real road scene images are rapidly accumulated due to the failure to reach the defined timing period.
4. The method for entertainment interpretation experience based on mobile real-scene cognition according to claim 3 is characterized in that: In step 1, after completing the detection and monitoring, a unique authentication code is generated for each detected road real scene image, so that each road real scene image generates a numerical mark in the smart camera, and the control transmits the numerical mark to the AR information display system when executing the transmission of the road real scene image to the AR information display system. After receiving the road real scene image, the AR information display system uses the same mark processing to compare the obtained numerical mark with the transmitted numerical mark. If the two marks are the same, they are the same value. Otherwise, it means that an error occurred in the transmission of the road real scene image.
5. The method for entertainment interpretation experience based on mobile real-scene cognition according to claim 4, characterized in that: In step 2, before channel configuration, the transmission efficiency of the current Bluetooth network is measured. When the transmission channel of the Bluetooth network with the measured efficiency less than the critical value temporarily interrupts the transmission of the real road scene image, the channel with the best measured efficiency is selected to perform the transmission of the real road scene image.
6. The method for entertainment interpretation experience based on mobile real-scene cognition according to claim 5, characterized in that: In step 2, when the Bluetooth network transmission channel has a measured efficiency less than a critical value, the transmission of the real road scene image is temporarily interrupted, and then it is controlled to transmit a backup of the valid real road scene image to the AR information display system.
7. The method for entertainment interpretation experience based on mobile real-scene cognition according to claim 6, characterized in that: In step 3, the real-scene image of the road transmitted to the AR information display system is collected, and retransmission and storage control can be performed; after the real-scene image of the road from the smart camera is collected, it can be controlled to store the collected real-scene image of the road in the information table of the AR information display system for the real-scene image transmission of the AR information display system, and can then be used by the AR information display system to face the set real-scene image of the road.
8. The method for entertainment interpretation experience based on mobile real-scene cognition according to claim 7, characterized in that: In step 3, after obtaining the real-scene image of the road to be transmitted, the transmission processing of the real-scene image of the road is performed according to the number of smart cameras on the chain; after completing the parsing configuration of the set configuration document, the real-scene image of the road to be transmitted is obtained and according to the number of smart cameras on the chain, the transmitter and receiver of the transmission service of the corresponding smart camera are constructed, and after the transmitter and receiver of the transmission are initialized, the transmission service is centrally controlled through the main program. Here, after the smart camera is started, the service is obtained through the information table at a regular interval, and the service arrangement and transmission are performed according to the configured transmission rules. The service message is synchronously transmitted to the AR information display system, and the service message will be waited for after work. After obtaining new service, it starts to listen to whether the Bluetooth network is connected. If it is connected, the actual transmission service is started. Otherwise, it will wait for a period of time before transmitting again. After the transmission is completed, if the smart camera does not detect the new service, the service cancellation message is transmitted to destroy the started transmission service.
9. The method for entertainment interpretation experience based on mobile real-scene cognition according to claim 8, characterized in that: In step 3, the information table is used to store the real-scene image of the Bluetooth network, and the backup is performed on a pair of AR information display systems, and a synchronization method is configured between the pair of information tables to perform the backup; In step 4, the AR information display system generates a patch when the smart camera executes the refresh, and synchronously executes the patch transmission. If the patch is valid and the refresh conditions allow, the patch is executed. If the patch is not successful, it will wait for a period of time and then continue to patch. After the patch fails to reach the set frequency, it is determined that the patch is wrong, and the patch is synchronously deleted from the folder to ensure the reasonable execution of the refresh; The road real-scene image transmission of the Bluetooth network transmission channel is implemented in a distributed storage manner, so that each participating network element can independently and completely store the road real-scene image in the corresponding space. When the transmitted road real-scene image is lost or modified, the restored control can be performed based on the stored road real-scene image.
10. A device for entertainment experience based on mobile real-scene recognition, characterized in that: include: The head-up display provided on the vehicle is electrically connected to the AR information display system, and the AR information display system is connected to the smart camera via Bluetooth network. The smart camera is used to sample the real road scene image when the vehicle is working and transmit it to the AR information display system. The AR information display system is used to determine the predicted display position of the corresponding AR information based on the collected real road scene image, and finally control the head-up display to display the AR information to improve the user experience; The devices for entertainment experience based on mobile real scene recognition also include: A processing module, which is used to detect the real road scene image and transmit it to the AR information display system for processing; A refresh module, which is used to perform function measurement and response refresh processing of Bluetooth network transmission channels; An analysis module, which is used to perform control and management analysis on the transmission of the road real scene image; The control module is used to control the refresh execution of the smart camera of the Bluetooth network.
Citation Information
Patent Citations
AR (Augmented Reality) information display method, vehicle and device under real-time moving real scene
CN116630577A