Method for combining desktop display and movable projection of multifunctional interactive computer

Abstract

The invention relates to the technical field of projection, and discloses a multifunctional interactive computer desktop display and movable projection combined method, which comprises the following steps: step 1, wireless docking; 2, integrating multiple functions; step 3, projection relevance identification; 4, sorting projection contents; 5, performing deep logic analysis; and step 6, assigning projection. According to the invention, a plurality of interaction modes, namely voice, gestures and cloud synchronization, are integrated on one platform, a user selects the most appropriate interaction mode according to requirements, projection content is highly related to user requirements through character recognition and view recognition technologies, and deep logic analysis ensures that low-correlation content does not interfere with the user, so that the user experience is improved. A user can customize projection contents and sequences according to requirements, different use scenes are met, equipment connection is more flexible through a wireless docking technology, the system is suitable for various environments and scenes, and the beneficial effect that multifunctional interactive computer desktop information sources are projected at the same time is achieved.

Description

Technical Field

[0001] The invention relates to the technical field of projection, in particular to a method for combining a multifunctional interactive computer desktop display with a movable projection. Background Art

[0002] Computers, commonly known as computers, are modern electronic computing machines used for high-speed computing. With the rapid development of electronic technology, there are more and more types of computers, including tablets. Existing tablets need to be used with a projection device when performing projection operations. Connect the projector to the computer via an HDMI or VGA cable, turn on the projector and the computer, make sure the projector is in input signal mode, adjust the display settings on the computer, and make sure that the desktop content is displayed on both the computer screen and the projector; Advantages: stable and low latency, but the cable limits the mobility of the projector. In order to solve the limitation of the projection device for remote projection, wireless projection is required. Connect the wireless projection device: such as Chromecast or Miracast adapter to the HDMI port of the projector, and make sure it is connected to the same Wi-Fi network, turn on the wireless projection function on the computer, and select the projector device for pairing. The advantage is that it is easy to move and does not require cables, but there is a certain delay, and it relies on the wireless network. It cannot be used in areas with no signal or strong electromagnetic interference.

[0003] Although the wireless projection technology in the above-mentioned existing materials can project the content to be projected into the projector, with the development of technology, computers have long been multi-functional interactive. Although it is just a computer, it has multiple information sources including voice interaction, gesture recognition, dynamic wallpaper, smart split screen and cloud synchronization backup. When multiple information sources are projected at the same time, the projector cannot distinguish the importance of the projections and can only sort the output according to the timeline. This can be easily exploited in actual applications, resulting in invalid projection content filling the projector timeline, the real content cannot be played, and the projection content that really needs to be output cannot be determined based on the multi-signal source recognition of the computer desktop, and it cannot interact synchronously with the multi-functional computer desktop. Summary of the invention

[0004] Technical issues solved: In view of the deficiencies in the prior art, the present invention provides a method for combining a multifunctional interactive computer desktop display with a movable projection, which has the advantages of simultaneously projecting the multifunctional interactive computer desktop information sources, solving the problem that the input side projection cannot be arranged and played according to the importance of the projections, and solving the problems of the above-mentioned technologies.

[0005] Technical solution: To achieve the above object, the present invention provides the following technical solution: a method for combining a multifunctional interactive computer desktop display with a movable projection, comprising the following steps: Step 1: Wireless docking: wirelessly dock the computer desktop to be projected with the mobile projector; Step 2, multi-function integration: voice interaction, gesture recognition, dynamic wallpaper, smart split screen and cloud synchronization backup are integrated into a multi-function module, and the content belonging to the multi-function module belongs to the projection content. The voice interaction includes voice command and voice input. The voice command is executed by a voice assistant to open an application, search for information and set reminders. The voice input supports voice input text; the gesture recognition includes air gestures and facial recognition. The air gestures recognize air gestures through a camera or sensor, and the computer can be operated without touching the screen. The smart desktop layout includes dynamic wallpaper and smart split screen. The dynamic wallpaper supports dynamic wallpaper and screen saver. The smart split screen supports smart split screen of multiple applications to improve multi-tasking efficiency. The cloud synchronization backup includes file synchronization and automatic backup. The file synchronization supports cloud synchronization of files and settings. The automatic backup automatically backs up important data regularly to prevent data loss. Step 3, projection relevance recognition: Analyze the relevance between the content input from the multi-function module and the current projection playback content. The relevance recognition is divided into text recognition and view recognition. The text recognition prioritizes the title content, and then recognizes the keywords. The view recognition prioritizes the title in the view, and then recognizes the people, objects, shapes and images in the view. The relevance calculation is expressed in relevance. If the relevance is less than 20%, it is invalid input, otherwise it is valid input. Step 4: Sorting the projection content: Sort the projection order according to the degree of relevance, the higher the degree of relevance, the higher the ranking; Step 5, deep logic analysis: deep logic analysis is performed on input content with a correlation of less than 20%. First, the source information transmission frequency is determined. The higher the transmission frequency per minute / time, the higher the invalidity, with a maximum of 30%. Secondly, it is determined whether the source information is sent by the computer desktop account holder. If not, the invalidity is 30%, and if so, it is 0%. Finally, the interval between the source information and the valid input is determined, with 10s as the judgment interval. The shorter the interval, the higher the invalidity, with a maximum of 30%. If the cumulative invalidity is less than 60%, it returns to step 5 for sorting. Step 6. Specify projection: Holders of voice interaction, gesture recognition, dynamic wallpaper, smart split screen and cloud synchronization backup can directly specify the projection order after performing secondary verification of their respective functions.

[0006] Preferably, the specific steps of wireless connection in step 1 are: S1. Ensure device compatibility: Confirm that the computer supports wireless display technology, including Miracast, Chromecast and AirPlay, and confirm that the projector supports wireless connection and has a corresponding receiver or built-in wireless module; S2. Check the network connection: Connect the computer and projector to the same Wi-Fi network and make sure the router supports the necessary wireless display protocols; S3. Set up wireless display on your computer: Windows: Open "Settings" > "System" > "Project to this PC", turn on "Allow other devices to discover this PC for projection"; S5. Connect to a projector: Via Miracast: On your computer, right-click on the desktop, select "Connect to a wireless display", select the projector device and enter the PIN; S6. Adjust display settings: Extend mode uses the projector as a second display to extend the desktop; Clone mode copies the computer screen content to the projector; Projector only displays the content only on the projector, and the computer screen becomes black; S7. Test the connection: Move the mouse or change the display content on the computer, confirm that it is updated synchronously on the projector, and adjust the volume and image settings to ensure the audio and video quality.

[0007] Preferably, the voice command accuracy in step 2 is calculated as: Voice command accuracy = ; The accuracy of speech-to-text conversion is calculated as: ; The gesture recognition accuracy is calculated as: ; The facial recognition accuracy is calculated as: ; The efficiency of intelligent split screen is calculated as: .

[0008] Preferably, the comprehensive score in step 2 is calculated as: .

[0009] Preferably, the correlation degree of the character recognition in step 3 is calculated as: ; The view identification relevance is calculated as: .

[0010] Preferably, the comprehensive correlation degree in step 3 is calculated as: ; The correlation is determined as follows: .

[0011] Preferably, the representation of the correlation degree in step 4 is calculated as: have projection contents, and the relevance of each content is ,in .

[0012] ; The sorting in step 4 also includes target calculation, and the target calculation of the sorting is: ; in: is a permutation function, indicating ; is a list of relevance; is the sorted list.

[0013] Preferably, the ranking calculation in step 4 is: ; Among them: The two contents currently being compared are and ,in ,and ; The step 4 of sorting also includes further determining whether the position of each content after sorting meets the requirement of decreasing relevance by calculation: ; in: .

[0014] Preferably, the frequency of the selected information determined in step 5 is calculated as: ; in: is the transmission frequency, times / minute; In step 5, the interval between the source information and the valid input is determined as: ; in: is the interval time, in seconds, It is the ratio of invalidity change corresponding to the change of interval time per second.

[0015] Preferably, the addition invalidity in step 5 is calculated as: ; The judgment calculation is: .

[0016] Compared with the prior art, the present invention provides a method for combining a multifunctional interactive computer desktop display with a movable projection, which has the following beneficial effects: 1. The present invention integrates multiple interaction modes: voice, gesture and cloud synchronization into one platform. Users can choose the most appropriate interaction mode according to their needs. Through text recognition and view recognition technology, it is ensured that the projected content is highly relevant to user needs. Deep logical analysis ensures that low-correlation content will not interfere with users, thereby improving the quality of projection content. Users can customize projection content and sequence according to their needs to meet different usage scenarios. Wireless docking technology makes device connection more flexible and suitable for a variety of environments and scenarios. Automatic backup and deep logical analysis improve the reliability and stability of the system, achieving the beneficial effect of simultaneous projection of multi-functional interactive computer desktop information sources.

[0017] 2. The present invention arranges the projection content according to its importance through correlation identification and sorting to ensure that key information is played first. Deep logical analysis further screens out inefficient information to avoid interference from irrelevant content. Low-correlation content is identified as invalid input to avoid invalid information occupying projection resources. Valid input content is sorted according to the correlation to ensure the efficiency and practicality of the projection content. Users can directly specify the projection order through voice, gestures, etc. to meet personalized needs. Cloud synchronization and automatic backup functions ensure the security and reliability of information. The smart split-screen function supports the simultaneous display of multiple applications, which improves the efficiency of multi-tasking. The combination of dynamic wallpaper and smart split-screen enhances the visual appeal and practicality of the desktop, achieving the beneficial effect of solving the problem that the input-side projection cannot be arranged and played according to the importance of the projection. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 It is a schematic diagram of the process flow of the present invention. DETAILED DESCRIPTION

[0019] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0020] See also Figure 1 , a method for combining a multifunctional interactive computer desktop display with a movable projection, comprising the following steps: Step 1: Wireless docking: wirelessly dock the computer desktop to be projected with the mobile projector; Step 2, multi-function integration: voice interaction, gesture recognition, dynamic wallpaper, smart split screen and cloud synchronization backup are integrated into a multi-function module, and the content belonging to the multi-function module belongs to the projection content. The voice interaction includes voice command and voice input. The voice command is executed by a voice assistant to open an application, search for information and set reminders. The voice input supports voice input text; the gesture recognition includes air gestures and facial recognition. The air gestures recognize air gestures through a camera or sensor, and the computer can be operated without touching the screen. The smart desktop layout includes dynamic wallpaper and smart split screen. The dynamic wallpaper supports dynamic wallpaper and screen saver. The smart split screen supports smart split screen of multiple applications to improve multi-tasking efficiency. The cloud synchronization backup includes file synchronization and automatic backup. The file synchronization supports cloud synchronization of files and settings. The automatic backup automatically backs up important data regularly to prevent data loss. Step 3, projection relevance recognition: Analyze the relevance between the content input from the multi-function module and the current projection playback content. The relevance recognition is divided into text recognition and view recognition. The text recognition prioritizes the title content, and then recognizes the keywords. The view recognition prioritizes the title in the view, and then recognizes the people, objects, shapes and images in the view. The relevance calculation is expressed in relevance. If the relevance is less than 20%, it is invalid input, otherwise it is valid input. Step 4: Sorting the projection content: Sort the projection order according to the degree of relevance, the higher the degree of relevance, the higher the ranking; Step 5, deep logic analysis: deep logic analysis is performed on input content with a correlation of less than 20%. First, the source information transmission frequency is determined. The higher the transmission frequency per minute / time, the higher the invalidity, with a maximum of 30%. Secondly, it is determined whether the source information is sent by the computer desktop account holder. If not, the invalidity is 30%, and if so, it is 0%. Finally, the interval between the source information and the valid input is determined, with 10s as the judgment interval. The shorter the interval, the higher the invalidity, with a maximum of 30%. If the cumulative invalidity is less than 60%, it returns to step 5 for sorting. Step 6. Specify projection: Holders of voice interaction, gesture recognition, dynamic wallpaper, smart split screen and cloud synchronization backup can directly specify the projection order after performing secondary verification of their respective functions.

[0021] Embodiment 1 Scenario description: Speakers need to present multiple documents and presentations to attendees while arranging the order of projections based on the importance and relevance of the content.

[0022] Steps and data results: Wireless docking (step 1): The speaker uses a computer to connect wirelessly to the projector in the conference room via Miracast.

[0023] Data results: The computer and projector successfully established a wireless connection and synchronized the computer desktop in real time.

[0024] Multifunctional integration (step 2): The speaker uses voice commands to open presentations and related documents.

[0025] Data results: Presentations and documents are opened on the computer desktop, with integrated voice recognition and gesture recognition functions.

[0026] Projection correlation identification (step three): Text recognition: Identify presentations with titles such as “2023 Quarterly Report” and keywords such as “sales data” and “market analysis”.

[0027] View Identification: Identify sales charts and market trend graphs in documents.

[0028] Calculate the correlation: Text recognition relevance: number of matching titles + number of matching keywords / (total number of titles + total number of keywords) × 100%; The presentation has 1 title, 3 keywords, 1 total title, and 5 total keywords.

[0029] Text recognition relevance = (1 + 3) / (1 + 5) × 100% = 66.67%; View recognition relevance: number of matching titles + number of matching objects, etc. / (total number of titles + total number of objects, etc.) × 100%; 1 sales chart in the document, market trends Figure 1 The total number of objects is 2.

[0030] View identification relevance = (0 + 2) / (0 + 2) × 100% = 100%; Comprehensive relevance: (text recognition relevance + view recognition relevance) / 2; Overall correlation = (66.67% + 100%) / 2 = 83.33%.

[0031] Projection content sorting (step 4): Sort by relevance, putting the content with high relevance at the front.

[0032] Data results: The projection order is: Presentation “2023 Quarterly Report” (83.33%); Market trend chart in the document (100%); Sales data table (correlation degree is 80%).

[0033] Deep logical analysis (step five): Conduct in-depth logical analysis on content with a correlation degree below 20%, such as information transmission frequency, information source, etc.

[0034] Data Outcome: Filter out irrelevant information, such as irrelevant email notifications.

[0035] Specify projection (step six): The speaker uses gestures to specify that a specific document should be projected first.

[0036] Data results: Adjust the projection order to put the specified document first.

[0037] Final data results: The projected content is arranged according to relevance and user-specified order, ensuring that content that is highly relevant to the meeting topic is displayed first, improving meeting efficiency and the accuracy of information transmission.

[0038] Embodiment 2 Family members use a projector in the living room to watch movies and TV shows, with projected content recommended and sorted based on personal interests and viewing history.

[0039] Steps and data results: Wireless docking (step 1): Family members use smart TVs or media players to connect wirelessly to the projector via Chromecast.

[0040] Data results: The TV or player successfully establishes a wireless connection with the projector to achieve high-definition video projection.

[0041] Multifunctional integration (step 2): Users search for movies and TV shows using voice commands.

[0042] Data results: Voice recognition function responds and a list of search results is displayed.

[0043] Projection correlation identification (step three): Text recognition: Identify titles and descriptions of movies and TV shows.

[0044] For example, searching for "science fiction movies" will identify "Movie One", "Movie Two", etc.

[0045] View Identification: Extract key visual elements from movie posters and trailers.

[0046] Calculate the correlation: Text recognition relevance: "Movie One" has 1 title, 3 keywords, 1 title in total, and 5 keywords in total.

[0047] Text recognition relevance = (1 + 3) / (1 + 5) × 100% = 66.67%; View identification relevance: The poster and trailer of "Movie One" match 1 visual element, with a total of 2 visual elements.

[0048] View identification relevance = (0 + 1) / (0 + 2) × 100% = 50% Comprehensive correlation: Overall correlation = (66.67% + 50%) / 2 = 58.33%; Similarly, the overall relevance of Movie 2 is 65%.

[0049] Projection content sorting (step 4): Sort by relevance and put the content that users may be interested in at the front.

[0050] Data results: The order of projection content is: "Movie 2" (65%); "Movie 1" (58.33%); "Movie Three" (60% correlation).

[0051] Deep logical analysis (step five): Conduct deep logical analysis on content with a relevance of less than 20%, taking into account user viewing frequency and time interval.

[0052] Data results: Filter out content that users are not interested in or have watched multiple times.

[0053] Specify projection (step six): The user can directly select a movie to play through gestures.

[0054] Data Result: The projection immediately switches to the movie specified by the user and starts playing.

[0055] Final data results: The projected content is intelligently sorted according to the user's interests and viewing history, allowing users to quickly find and watch content of interest, improving the convenience and satisfaction of home entertainment.

[0056] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and alterations may be made to the embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the appended claims and their equivalents.

Claims

1. A method for combining a multifunctional interactive computer desktop display with a movable projection, characterized in that: The following steps are involved: Step 1: Wireless docking: wirelessly dock the computer desktop to be projected with the mobile projector; Step 2: Multi-function integration: voice interaction, gesture recognition, dynamic wallpaper, smart split screen and cloud synchronization backup are integrated into a multi-function module. The content belonging to the multi-function module belongs to the projection content. The voice interaction includes voice commands and voice input. The voice commands are executed by the voice assistant to open applications, search for information and set reminders. The voice input supports voice input of text. The gesture recognition includes air gestures and facial recognition. The air gestures recognize air gestures through a camera or sensor, and the computer can be operated without touching the screen. The smart desktop layout includes dynamic wallpaper and smart split screen. The dynamic wallpaper supports dynamic wallpaper and screen saver. The smart split screen supports smart split screen of multiple applications to improve multi-tasking efficiency. The cloud synchronization backup includes file synchronization and automatic backup. The file synchronization supports cloud synchronization of files and settings. The automatic backup automatically backs up important data regularly to prevent data loss. Step 3, projection relevance recognition: Analyze the relevance between the content input from the multi-function module and the current projection playback content. The relevance recognition is divided into text recognition and view recognition. The text recognition prioritizes the title content, and then recognizes the keywords. The view recognition prioritizes the title in the view, and then recognizes the people, objects, shapes and images in the view. The relevance calculation is expressed in relevance. If the relevance is less than 20%, it is invalid input, otherwise it is valid input. Step 4: Sorting the projection content: Sort the projection order according to the degree of relevance, the higher the degree of relevance, the higher the ranking; Step 5, deep logic analysis: deep logic analysis is performed on input content with a correlation of less than 20%. First, the source information transmission frequency is determined. The higher the transmission frequency per minute / time, the higher the invalidity, with a maximum of 30%. Secondly, it is determined whether the source information is sent by the computer desktop account holder. If not, the invalidity is 30%, and if so, it is 0%. Finally, the interval between the source information and the valid input is determined, with 10s as the judgment interval. The shorter the interval, the higher the invalidity, with a maximum of 30%. If the cumulative invalidity is less than 60%, it returns to step 5 for sorting. Step 6. Specify projection: Holders of voice interaction, gesture recognition, dynamic wallpaper, smart split screen and cloud synchronization backup can directly specify the projection order after performing secondary verification of their respective functions.

2. The method of combining a multifunctional interactive computer desktop display with a movable projection according to claim 1, characterized in that: The specific steps of wireless connection in step 1 are as follows: S1. Ensure device compatibility: Confirm that the computer supports wireless display technology, including Miracast, Chromecast and AirPlay, and confirm that the projector supports wireless connection and has a corresponding receiver or built-in wireless module; S2. Check the network connection: Connect the computer and projector to the same Wi-Fi network and make sure the router supports the necessary wireless display protocols; S3. Set up wireless display on your computer: Windows: Open "Settings" > "System" > "Project to this PC", turn on "Allow other devices to discover this PC for projection"; S5. Connect to a projector: Via Miracast: On your computer, right-click on the desktop, select "Connect to a wireless display", select the projector device and enter the PIN; S6. Adjust display settings: Extend mode uses the projector as a second display to extend the desktop; Clone mode copies the computer screen content to the projector; Projector only displays the content only on the projector, and the computer screen becomes black; S7. Test the connection: Move the mouse or change the display content on the computer, confirm that it is updated synchronously on the projector, and adjust the volume and image settings to ensure the audio and video quality.

3. The method of combining a multifunctional interactive computer desktop display with a movable projection according to claim 2, characterized in that: The voice command accuracy rate in step 2 is calculated as: Voice command accuracy = ; The accuracy of speech-to-text conversion is calculated as: ； The gesture recognition accuracy is calculated as: ； The facial recognition accuracy is calculated as: ； The efficiency of intelligent split screen is calculated as: 。 4. The method of combining a multifunctional interactive computer desktop display with a movable projection according to claim 1, characterized in that: The comprehensive score in step 2 is calculated as: 。 5. The method of combining a multifunctional interactive computer desktop display with a movable projection according to claim 4, characterized in that: The correlation degree of the character recognition in step 3 is calculated as: ； The view identification relevance is calculated as: 。 6. The method of combining a multifunctional interactive computer desktop display with a movable projection according to claim 1, characterized in that: The comprehensive correlation degree in step 3 is calculated as: ； The correlation is determined as follows: 。 7. The method of combining a multifunctional interactive computer desktop display with a movable projection according to claim 1, characterized in that: The calculation of the correlation degree in step 4 is: have projection contents, and the relevance of each content is ,in ; ； The sorting in step 4 also includes target calculation, and the target calculation of the sorting is: ； in: is a permutation function, indicating ; is a list of relevance; is the sorted list.

8. The method of combining a multifunctional interactive computer desktop display with a movable projection according to claim 7, characterized in that: The sorting calculation in step 4 is: ； Among them: The two contents currently being compared are and ,in ,and ; The step 4 of sorting also includes further determining whether the position of each content after sorting meets the requirement of decreasing relevance by calculation: ； in: .

9. The method of combining a multifunctional interactive computer desktop display with a movable projection according to claim 1, characterized in that: The frequency of the selected information determined in step 5 is calculated as: ； in: is the transmission frequency, times / minute; In step 5, the interval between the source information and the valid input is determined as: ； in: is the interval time, in seconds, It is the ratio of invalidity change corresponding to the change of interval time per second.

10. The method of combining a multifunctional interactive computer desktop display with a movable projection according to claim 1, characterized in that: The calculation of the invalidity of the addition in step 5 is: ； The judgment calculation is: .

Images