Cloud mobile phone device, application device, camera calling system and method

Abstract

The invention relates to the technical field of cloud mobile phones, in particular to a cloud mobile phone device, an application device and a camera calling system and method.The cloud mobile phone device comprises a cloud mobile phone data obtaining module used for obtaining starting information and point location information of the application device; the cloud mobile phone processor is used for obtaining a virtual cloud mobile phone according to the starting information, adjusting the virtual cloud mobile phone according to the point location information to obtain operation picture information and transmitting the operation picture information to a corresponding application device; wherein the cloud mobile phone processor performs triggering operation through the current running state of the virtual cloud mobile phone and the obtained point location information, sends a camera calling instruction and obtains camera shooting information under the condition that the triggering result of the point location information corresponding to the current running state is shooting starting, obtains adjusted running picture information according to the camera shooting information, and sends the adjusted running picture information to the cloud mobile phone. The cloud mobile phone can normally operate applications related to camera shooting, and the use experience of the cloud mobile phone is improved.

Description

Technical Field

[0001] The present application relates to the field of cloud phone technology, and in particular to a cloud phone device, an application device, a camera call system and a method. Background Art

[0002] With the rapid development of cloud computing and virtualization technologies, virtual cloud phones have gained widespread adoption in business applications and personal entertainment. These phones allow users to run a complete mobile operating system and applications in the cloud, eliminating the need for a specific physical device and significantly reducing the consumption of local phone resources.

[0003] Although the functions of virtual cloud phones are basically the same as those of real phones and can reduce hardware requirements, cloud phones do not have certain hardware, such as cameras, which means that the cameras cannot be called for shooting during use. This limitation makes some applications that require cameras unable to run normally on virtual cloud phones, affecting the user experience. The above problems need to be solved. Summary of the Invention

[0004] In order to enable cloud phones to operate camera-related applications normally and improve the user experience of cloud phones, this application provides a cloud phone device, application device, camera call system and method, using the following technical solutions:

[0005] In a first aspect, the present application provides a cloud phone device, comprising:

[0006] Cloud phone data acquisition module, used to obtain the startup information and point information of the application device;

[0007] A cloud phone processor is used to obtain a virtual cloud phone according to the startup information, adjust the virtual cloud phone according to the point information, obtain operation screen information, and transmit the operation screen information to the corresponding application device;

[0008] Among them, the cloud phone processor triggers the operation through the current operating status of the virtual cloud phone and the obtained point information. When the trigger result of the point information corresponding to the current operating status is to start shooting, it sends a camera call instruction to obtain the camera information, and obtains the adjusted operating screen information based on the camera information.

[0009] Preferably, the cloud phone processor further includes:

[0010] When the trigger result of the point information corresponding to the current operating state is to start shooting, the corresponding camera adjustment parameters are matched through the current operating state, and the camera adjustment parameters are sent to the corresponding application device.

[0011] Preferably, the cloud phone processor further includes:

[0012] Used to obtain historical information of adjustment parameters and time point information corresponding to the historical information of adjustment parameters, analyze the historical information of adjustment parameters and time point information, and obtain model analysis results;

[0013] Obtain an application startup probability threshold, compare the model analysis result with the application startup probability threshold, and match the corresponding camera adjustment parameters when the model analysis result is greater than the application startup probability threshold.

[0014] Preferably, the cloud phone processor further includes:

[0015] In a preset time interval, and when several model analysis results are all greater than the application startup probability threshold, the model analysis result with the largest value is taken to match the camera adjustment parameters.

[0016] Preferably, the cloud phone processor further includes:

[0017] The running screen information is encoded and transmitted to the corresponding application device.

[0018] In a second aspect, the present application provides a data processing method, which is applied to the cloud phone device as described above, wherein the cloud phone processor performs the following steps:

[0019] The trigger operation is performed through the current operating status of the virtual cloud phone and the obtained point information. When the trigger result of the point information corresponding to the current operating status is to start shooting, a camera call instruction is sent to obtain the camera information, and the adjusted operating screen information is obtained according to the camera information.

[0020] Preferably, it also includes:

[0021] When the trigger result of the point information corresponding to the current operating state is to start shooting, the corresponding camera adjustment parameters are matched by the current operating state, and the camera adjustment parameters are sent to the corresponding application device.

[0022] Preferably, it also includes:

[0023] Obtaining historical information of adjustment parameters and time point information corresponding to the historical information of adjustment parameters, analyzing the historical information of adjustment parameters and the time point information, and obtaining model analysis results;

[0024] Obtain an application startup probability threshold, compare the model analysis result with the application startup probability threshold, and match the corresponding camera adjustment parameters when the model analysis result is greater than the application startup probability threshold.

[0025] Preferably, it also includes:

[0026] In a preset time interval, and when several model analysis results are all greater than the application startup probability threshold, the model analysis result with the largest value is taken to match the camera adjustment parameters.

[0027] Preferably, it also includes:

[0028] The running screen information is encoded and transmitted to the corresponding application device.

[0029] In a third aspect, the present application provides an application device, comprising:

[0030] The application-side data receiving module is used to receive camera call instructions and running screen information sent by the cloud phone processor;

[0031] Camera, used for shooting and obtaining video information;

[0032] Display module, used to display according to the running screen information and receive point information;

[0033] The application-side processor is used to activate the camera according to the camera call instruction and send information to the cloud phone device for activation and adjustment;

[0034] Among them, the application-side processor obtains the startup information, sends the startup information to the cloud phone device to start the virtual cloud phone, and sends the camera information and point information to the cloud phone device for adjustment.

[0035] Preferably, the application-side processor further includes:

[0036] Obtain camera adjustment parameters, adjust the camera according to the camera adjustment parameters, and obtain updated camera information.

[0037] Preferably, the application-side processor adjusts the camera according to the camera adjustment parameter, including:

[0038] Modify the camera according to the focal length information, brightness information and contrast information in the camera adjustment parameters.

[0039] Preferably, the application-side processor further includes:

[0040] The camera information is encoded and processed, and the encoded camera information is transmitted to the cloud phone device.

[0041] Preferably, the application-side processor transmits the encoded camera information to the cloud phone device, including:

[0042] According to the RTMP transmission protocol, the encoded camera information is transmitted to the cloud mobile device.

[0043] Fourthly, the present application provides a data processing method, which is applied to the application device as described above, and the application-side processor performs the following steps: obtaining startup information, sending the startup information to the cloud phone device to start the virtual cloud phone, and sending the camera information and point information to the cloud phone device for adjustment.

[0044] Preferably, it also includes:

[0045] Obtain camera adjustment parameters, adjust the camera according to the camera adjustment parameters, and obtain updated camera information.

[0046] Preferably, it also includes:

[0047] Modify the camera according to the focal length information, brightness information and contrast information in the camera adjustment parameters.

[0048] Preferably, it also includes:

[0049] The camera information is encoded and processed, and the encoded camera information is transmitted to the cloud phone device.

[0050] In a fifth aspect, the present application provides a camera call system, comprising:

[0051] The cloud phone device obtains the startup information and point information of the application device through the cloud phone data acquisition module;

[0052] The cloud phone device obtains a virtual cloud phone according to the startup information through the cloud phone processor, adjusts the virtual cloud phone according to the point information, obtains the operation screen information, and transmits the operation screen information to the corresponding application device;

[0053] The cloud phone processor triggers the operation through the current running state of the virtual cloud phone and the obtained point information. When the trigger result of the point information corresponding to the current running state is to start shooting, the camera call instruction is sent to obtain the camera information, and the adjusted running screen information is obtained according to the camera information.

[0054] The application device receives the camera call instruction and running screen information sent by the cloud phone processor through the application-side data receiving module;

[0055] The application device is used to shoot through a camera to obtain camera information;

[0056] The application device displays the operation screen information through the display module and receives the point information;

[0057] The application device activates the camera according to the camera call instruction through the application-side processor and sends information to the cloud phone device for activation and adjustment;

[0058] Among them, the application-side processor obtains the startup information, sends the startup information to the cloud phone device to start the virtual cloud phone, and sends the camera information and point information to the cloud phone device for adjustment.

[0059] In summary, compared with the prior art, the technical solution provided by this application has at least the following beneficial effects:

[0060] This application obtains startup information through the application device and transmits the startup information to the cloud phone data acquisition module. The cloud phone processor builds a virtual cloud phone corresponding to the application device according to the startup information, and transmits the obtained operation screen information to the display module. The application device displays the operation screen information through the display module, and inputs the point information through the display module, and transmits the point information to the cloud phone device. The cloud phone processor triggers the operation through the current operation status of the virtual cloud phone and the obtained point information. When the trigger result of the point information corresponding to the current operation status is to start shooting, a camera call instruction is sent. After receiving the camera call instruction, the camera of the application device starts the camera for shooting. The camera adjusts and pre-adjusts different parameters according to different camera call instructions, and transmits the camera information to the cloud phone processor for processing, obtains the adjusted operation screen information, and transmits it back to the application device for display, so that the cloud phone can operate camera-related applications normally, thereby improving the user experience of the cloud phone. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] Figure 1 This is a module diagram of a camera call system described in an embodiment of the present application.

[0062] Figure 2 This is a module diagram of the cloud phone device described in an embodiment of the present application.

[0063] Figure 3 It is a module schematic diagram of the application device described in the embodiment of the present application.

[0064] Description of reference numerals:

[0065] 1. Cloud phone installation; 2. Application installation. DETAILED DESCRIPTION

[0066] The following combination Figure 1-Figure 3 To further explain the present application in detail, the terms used in the embodiments of the present application are only for the purpose of describing specific embodiments and are not intended to be limiting.

[0067] Reference Figure 1 and Figure 2 , a cloud phone device involved in this application specifically includes:

[0068] Cloud phone data acquisition module, used to obtain the startup information and point information of the application device;

[0069] A cloud phone processor is used to obtain a virtual cloud phone according to the startup information, adjust the virtual cloud phone according to the point information, obtain operation screen information, and transmit the operation screen information to the corresponding application device;

[0070] Among them, the cloud phone processor triggers the operation through the current operating status of the virtual cloud phone and the obtained point information. When the trigger result of the point information corresponding to the current operating status is to start shooting, it sends a camera call instruction to obtain the camera information, and obtains the adjusted operating screen information based on the camera information.

[0071] Specifically, the cloud phone device of the present application embodiment is a cloud device that builds a virtual cloud phone for an application device. The cloud phone device and the application device transmit information and data via wireless communication. One cloud phone device can simultaneously connect to multiple application devices and build virtual cloud phones for multiple application devices at the same time. The information and data related to each built virtual cloud phone are sent to the corresponding application device for presentation.

[0072] Since virtual cloud phones are built in the cloud, the current problem is that they cannot access the required physical devices to obtain resource information, including cameras. This limitation makes it impossible for some applications that require cameras to run normally on virtual cloud phones, such as real-time video conferencing, video calls and chats, security monitoring, mobile IoT device monitoring, live broadcasting, facial recognition, camera-based virtual reality and augmented reality applications, etc.

[0073] The embodiment of the present application obtains the startup information and point information of the application device through the cloud phone data acquisition module, and then uses the cloud phone processor to obtain a virtual cloud phone according to the startup information, and adjusts the virtual cloud phone according to the point information to obtain the operation screen information, and transmits the operation screen information to the corresponding application device.

[0074] Among them, the startup information is entered by the user in the application device. After receiving the startup information, the application device transmits it to the cloud phone device via wireless communication. After the cloud phone data acquisition module obtains the startup information, the cloud phone processor builds a corresponding virtual cloud phone for the application device.

[0075] A virtual cloud phone is a virtualized mobile phone service provided by cloud computing technology, allowing users to run virtual phone applications on a variety of devices. The first step in the activation process is to launch the virtual cloud phone application on a device such as a computer, tablet, or actual phone. This application connects via the internet to a cloud server (the cloud phone device) hosting the virtual phone instance. Once connected, the user can access and operate the remote virtual phone on their local device, experiencing functions similar to those of a real phone.

[0076] When a virtual cloud phone is built and transmitted to an application device for use, the user clicks on the screen displayed by the application device to obtain point information and transmit it to the cloud phone processor. When the trigger result of the point information corresponding to the current operating state is to start shooting, a camera call instruction is sent to the application device to start the camera, and the camera information obtained by the camera is transmitted to the cloud phone device, so that the cloud phone processor obtains the camera information.

[0077] Camera information refers to the visual data captured by a camera, including images and videos. This information includes visual elements such as light, color, and detail, and is used to create a digital representation of the actual scene. The data is typically encoded in the form of a pixel array, and compression algorithms such as JPEG and H.264 are often used during transmission to reduce file size and improve transmission efficiency. During transmission, the data is divided into small blocks and transmitted over the network. The receiving end reassembles these blocks and decodes them to restore the original image or video.

[0078] After the cloud phone processor obtains the camera information and before the cloud phone device obtains the camera exit instruction, the running screen information is the called camera application interface and the corresponding camera information screen.

[0079] As one implementation method, the cloud phone processor further includes:

[0080] When the trigger result of the point information corresponding to the current operating state is to start shooting, the corresponding camera adjustment parameters are matched through the current operating state, and the camera adjustment parameters are sent to the corresponding application device.

[0081] Specifically, the cloud phone device of the embodiment of the present application obtains and stores a number of camera adjustment parameters for different application operation conditions during the process of configuring parameters or inputting preset information. When the initial operation screen information is obtained, that is, when the virtual cloud phone is running, it is necessary to analyze in real time whether the current operation state has changed to start shooting.

[0082] Analyze whether the running screen information has the corresponding point information that triggers the start of shooting. If not, the current running status is that the camera is not started. If the point information exists and is obtained, the current running status is that the shooting is started, so as to analyze and obtain the current running status.

[0083] For example, when the cloud phone device starts the virtual cloud phone and processes the initial operation screen information, and transmits the initial operation screen information to the application device, the content displayed by the virtual cloud phone is the system desktop. The user slides the display module on the application device to a page displaying the camera application. At this time, there are camera-related points in the operation screen information of the cloud phone device, and the user clicks the camera application in the display module, so that the cloud phone processor receives the point information that the current operation status is to start shooting, and the current operation status is the desktop click camera.

[0084] The cloud phone processor matches the camera adjustment parameters of the corresponding state according to the current operating state, and then sends the parameters to the application device, so that the camera parameters opened by the application device are adjusted to the corresponding parameters to be adjusted when the camera is clicked on the desktop, so that the application device can present a shooting picture suitable for the current operating state.

[0085] Since opening the camera on the desktop is a common daily photography operation, users demand a simple and intuitive shooting experience. Medium to high resolutions ensure image clarity, while autofocus and exposure adapt to different shooting environments, and automatic white balance ensures accurate colors to accommodate a wide range of shooting scenarios.

[0086] Therefore, the camera settings include: Resolution: Medium to high resolution, such as 1080p, for moderate clarity; Focus: Autofocus; Exposure: Automatic to adapt to various lighting conditions; White balance: Automatic; Filter: Default or No filter to maintain pristine image quality; Frame rate: 30fps, which meets general photography needs.

[0087] As another embodiment, when the cloud phone device starts the virtual cloud phone and processes to obtain the initial operation screen information, and transmits the initial operation screen information to the application device, the content displayed by the virtual cloud phone at this time is the live broadcast software. The user slides the display module on the application device to the live broadcast software displaying a page with the camera application opened. At this time, the operation screen information of the cloud phone device is within the live broadcast software, and there are camera-related points, and the user clicks on the camera application in the display module, so that the cloud phone processor receives the point information that the current operation status is to start shooting, and the current operation status at this time is to turn on the camera when the live broadcast software turns on the live broadcast function.

[0088] The cloud phone processor matches the camera adjustment parameters of the corresponding state according to the current operating state, and then sends the parameters to the application device, so that the camera parameters opened by the application device are adjusted to the corresponding parameters to be adjusted when the live broadcast software turns on the live broadcast function, so that the application device can present a shooting picture suitable for the current operating state.

[0089] Because live streaming requires high image quality and smoothness, high resolution and high frame rate can provide clear and smooth images. Beauty filters enhance the viewer experience, and automatic exposure and white balance can adapt to different lighting conditions, ensuring stable live streaming quality.

[0090] Therefore, the camera adjustment parameters at this time include: resolution: high resolution, such as 720p or 1080p, to make the live broadcast picture clear; focal length, autofocus or manual focus to adapt to the dynamic scene of the live broadcast; exposure uses automatic exposure, but manual adjustment options can be provided to adapt to different lighting conditions; white balance is set to automatic white balance, or preset options such as "indoor" and "outdoor" are provided; filter settings select enhanced skin color or beauty filters, provided according to the live broadcast platform and user needs; frame rate is set to 30fps to 60fps to improve the smoothness of the live broadcast picture; the front and rear cameras are switched as needed, and the rear camera is usually used to obtain higher image quality.

[0091] As another embodiment, when the cloud phone device starts the virtual cloud phone and processes to obtain the initial operation screen information, and transmits the initial operation screen information to the application device, the content displayed by the virtual cloud phone at this time is software related to face recognition, such as banking applications, payment applications, etc. that require face recognition software. The user slides the display module on the application device to the interface displaying the camera application. At this time, there are camera-related points in the operation screen information of the cloud phone device, and the user clicks on the camera application in the display module, so that the cloud phone processor receives the point information that the current operation status is to start shooting, and the current operation status at this time is to click on face recognition.

[0092] The cloud phone processor matches the camera adjustment parameters of the corresponding state according to the current operating state, and then sends the parameters to the application device, so that the camera parameters opened by the application device are adjusted to the parameters corresponding to the adjustment when clicking face recognition, so that the application device can present a shooting picture suitable for the current operating state.

[0093] Face recognition involves different scenarios. The application device obtains lighting information and sends it to the cloud phone device for pre-judgment. This embodiment of the application targets scenarios with normal lighting. High resolution and autofocus are crucial for clearly capturing facial details. Automatic exposure and white balance ensure consistent image quality in different environments. The frame rate needs to be high enough to support real-time recognition.

[0094] Therefore, the camera adjustment parameters in normal scenarios include: setting the resolution to high resolution, such as 1080p, to ensure recognition accuracy; setting the focal length to autofocus to ensure facial clarity; setting the exposure to automatic exposure to adapt to different ambient light; setting the white balance to automatic white balance; setting the filter to no filter to maintain the authenticity of the image; and setting the frame rate to 30fps, which is smooth enough to support real-time recognition.

[0095] As another embodiment, when the cloud phone device starts the virtual cloud phone and processes to obtain the initial operation screen information, and transmits the initial operation screen information to the application device, the content displayed by the virtual cloud phone at this time is software related to face recognition, such as banking applications, payment applications, etc. that require face recognition software. The user slides the display module on the application device to the interface displaying the camera application. At this time, there are camera-related points in the operation screen information of the cloud phone device, and the user clicks on the camera application in the display module, so that the cloud phone processor receives the point information that the current operation status is to start shooting, and the current operation status at this time is to click on face recognition.

[0096] The cloud phone processor matches the camera adjustment parameters of the corresponding state according to the current operating state, and then sends the parameters to the application device, so that the camera parameters opened by the application device are adjusted to the parameters corresponding to the adjustment when clicking face recognition, so that the application device can present a shooting picture suitable for the current operating state.

[0097] Among them, face recognition includes different situations. The application device obtains lighting information and sends it to the cloud phone device for pre-judgment. The embodiment of this application is aimed at the situation of low light environment. In this case, in low light environment, increasing the exposure setting and using a low light filter can improve image quality. Autofocus and medium resolution still ensure recognition accuracy, and 30fps maintains smooth recognition.

[0098] Therefore, the camera adjustment parameters in normal scenes include: setting the resolution to medium to high resolution, such as 720p or 1080p; setting the focal length to autofocus; setting the exposure to a high exposure setting, such as increasing ISO; adjusting the white balance to "low light" mode; setting the filter to select a low-light optimization filter, such as a low-noise filter; and setting the frame rate to 30fps to ensure smooth recognition in low-light environments.

[0099] As another embodiment, when the cloud phone device starts the virtual cloud phone and processes the initial operation screen information, and transmits the initial operation screen information to the application device, the content displayed by the virtual cloud phone at this time is an application related to video calls. The user slides the display module on the application device to a page displaying a camera application. At this time, there are camera-related points in the operation screen information of the cloud phone device, and the user clicks on the camera application in the display module, so that the cloud phone processor receives the point information that the current operation status is to start shooting, and the current operation status at this time is to click on the video call.

[0100] The cloud phone processor matches the camera adjustment parameters of the corresponding state according to the current operating state, and then sends the parameters to the application device, so that the camera parameters opened by the application device are adjusted to the corresponding parameters to be adjusted when clicking the video call in the application, so that the application device can present a shooting picture suitable for the current operating state.

[0101] Among them, medium resolution and autofocus are suitable for daily video calls, 30fps ensures smooth video, automatic exposure and white balance ensure good video quality, and beauty filters enhance the user's visual experience.

[0102] Therefore, the camera adjustment parameters at this time include: setting the resolution to a medium resolution, such as 720p, to ensure image clarity when traffic is limited; setting the focal length to autofocus; setting the exposure to automatic exposure to adapt to different lighting conditions; setting the white balance to automatic white balance; setting the filter to select a slight beauty filter to improve image quality; setting the frame rate to 30fps to ensure smooth calls; setting the front and rear cameras to usually use the front camera to facilitate users to view themselves and the other party.

[0103] As another embodiment, when the cloud phone device starts the virtual cloud phone and processes the initial operation screen information, and transmits the initial operation screen information to the application device, the content displayed by the virtual cloud phone at this time is an application related to video calls. The user slides the display module on the application device to a page displaying a camera application. At this time, there are camera-related points in the operation screen information of the cloud phone device, and the user clicks on the camera application in the display module, so that the cloud phone processor receives the point information that the current operation status is to start shooting, and the current operation status at this time is to click on the video call.

[0104] The cloud phone processor matches the camera adjustment parameters of the corresponding state according to the current operating state, and then sends the parameters to the application device, so that the camera parameters opened by the application device are adjusted to the corresponding parameters to be adjusted when clicking the video call in the application, so that the application device can present a shooting picture suitable for the current operating state.

[0105] High resolution and frame rate are crucial to the VR experience, ensuring clear and smooth images. Automatic exposure and white balance adjust to changes in the virtual environment, and dedicated filters enhance the visual effects of VR.

[0106] Therefore, the camera adjustment parameters at this time include: the resolution is set to high resolution, such as 1080p or higher, to provide a clear visual experience; the focal length is set to autofocus or fixed focal length, and the specific value here is determined according to the requirements of different virtual reality applications; the exposure is set to automatic exposure or adjusted according to the virtual environment, such as high exposure; the white balance is set to adjust according to the virtual reality environment, such as automatic or specific mode; the filter is set to a filter that may be required for virtual reality, such as enhancing the perspective or depth perception, corresponding to the application setting; the frame rate is set to a high frame rate, such as 60fps or higher, to ensure smoothness and immersion in virtual reality; for the front and rear cameras, the front camera is generally used, or adjusted according to the configuration requirements of the virtual reality device.

[0107] As one implementation method, the cloud phone processor further includes:

[0108] Used to obtain historical information of adjustment parameters and time point information corresponding to the historical information of adjustment parameters, analyze the historical information of adjustment parameters and time point information, and obtain model analysis results;

[0109] Obtain an application startup probability threshold, compare the model analysis result with the application startup probability threshold, and match the corresponding camera adjustment parameters when the model analysis result is greater than the application startup probability threshold.

[0110] Specifically, the adjustment parameter history information specifically refers to the camera adjustment parameters corresponding to the change of the current operating state and the corresponding time point information. The embodiment of the present application analyzes the adjustment parameter history information and time point information using a regression model, a time series model, or other models.

[0111] The embodiment of the present application first obtains adjustment parameter history information and time point information. Adjustment parameter history information refers to the record of adjustment parameters over a period of time. For example, it may include the camera's exposure time, brightness setting, etc. The time point information is the specific time when these adjustment parameters were recorded.

[0112] Then, historical information about adjustment parameters and time points is analyzed. The model analyzes historical data, typically including data preprocessing, feature extraction, and data cleaning. Through machine learning models, such as regression models and time series models, the model identifies the relationship between adjustment parameters and time, including pattern recognition and trend analysis.

[0113] After obtaining the model analysis results, they are used to predict the historical data of the adjustment parameters, including predictions for future adjustment parameters or optimization suggestions for existing parameters. For example, the model may predict the optimal camera adjustment parameters under specific conditions, such as a certain time period or environment.

[0114] Next, the app launch probability threshold is obtained. This threshold is a preset standard value used to determine whether the app launch probability has reached a critical point. The model analysis result is compared with the preset threshold. If the model analysis result is greater than the threshold, the model predicts a high probability of app launch in this situation.

[0115] Finally, based on the comparison results, the corresponding camera adjustment parameters are selected or adjusted. If the model predicts a high probability of application startup, the system will pre-acquire specific adjustment parameters to optimize the camera performance, thereby improving the efficiency or effect of application startup.

[0116] As one implementation method, the cloud phone processor further includes:

[0117] In a preset time interval, and when several model analysis results are all greater than the application startup probability threshold, the model analysis result with the largest value is taken to match the camera adjustment parameters.

[0118] Specifically, when the present embodiment obtains model analysis results, it uses a pre-stored application launch probability threshold for comparison. If the analysis results of multiple models all exceed this threshold, the system compares these results and selects the result with the largest value as the final decision basis. Finally, the camera adjustment parameters are matched based on this maximum value, thereby obtaining the most appropriate camera adjustment parameters at the current time.

[0119] As one implementation method, the cloud phone processor further includes:

[0120] The running screen information is encoded and transmitted to the corresponding application device.

[0121] Specifically, after the embodiment of the present application obtains the running screen information, the running screen information needs to be encoded before being transmitted to the corresponding application device.

[0122] The image information obtained from the cloud camera is processed to generate running image data, which includes video frames or image data.

[0123] After obtaining the running screen information, select the encoding standard. Select an appropriate encoding standard, such as H.264, H.265, etc., to achieve efficient video compression.

[0124] An encoding algorithm is then used to compress the running screen data into a coded stream. The encoding process removes redundant data and optimizes data transmission efficiency, allowing the video data to occupy less bandwidth during network transmission. The encoded data is then encapsulated into a suitable format, such as MP4 or MKV, and prepared for transmission.

[0125] Next, select a transmission protocol, such as TCP, UDP, HTTP, RTMP, or WebRTC, based on network conditions and real-time requirements. The encoded data stream is then transmitted to the application device via the network. The transmission process includes network routing, packet fragmentation, and reassembly, with the application device ultimately decoding and presenting the data.

[0126] The embodiment of the present application provides a data processing method, which is applied to the above-mentioned cloud phone device. The cloud phone processor performs the following steps:

[0127] The trigger operation is performed through the current operating status of the virtual cloud phone and the obtained point information. When the trigger result of the point information corresponding to the current operating status is to start shooting, a camera call instruction is sent to obtain the camera information, and the adjusted operating screen information is obtained according to the camera information.

[0128] As one implementation method, it also includes:

[0129] When the trigger result of the point information corresponding to the current operating state is to start shooting, the corresponding camera adjustment parameters are matched by the current operating state, and the camera adjustment parameters are sent to the corresponding application device.

[0130] As one implementation method, it also includes:

[0131] Obtaining historical information of adjustment parameters and time point information corresponding to the historical information of adjustment parameters, analyzing the historical information of adjustment parameters and the time point information, and obtaining model analysis results;

[0132] Obtain an application startup probability threshold, compare the model analysis result with the application startup probability threshold, and match the corresponding camera adjustment parameters when the model analysis result is greater than the application startup probability threshold.

[0133] As one implementation method, it also includes:

[0134] In a preset time interval, and when several model analysis results are all greater than the application startup probability threshold, the model analysis result with the largest value is taken to match the camera adjustment parameters.

[0135] As one implementation method, it also includes:

[0136] The running screen information is encoded and transmitted to the corresponding application device.

[0137] Reference Figure 3 , an embodiment of the present application provides an application device, including:

[0138] The application-side data receiving module is used to receive camera call instructions and running screen information sent by the cloud phone processor;

[0139] Camera, used for shooting and obtaining video information;

[0140] Display module, used to display according to the running screen information and receive point information;

[0141] The application-side processor is used to activate the camera according to the camera call instruction and send information to the cloud phone device for activation and adjustment;

[0142] Among them, the application-side processor obtains the startup information, sends the startup information to the cloud phone device to start the virtual cloud phone, and sends the camera information and point information to the cloud phone device for adjustment.

[0143] Specifically, the application-side data receiving module in the embodiments of the present application is primarily responsible for receiving camera call instructions and operating screen information from the cloud phone processor. The camera is responsible for the actual capture and generation of image data, which is then processed by the application-side processor. The application-side processor activates the camera based on the camera call instruction and sends the activation information to the cloud phone device, thereby activating the virtual cloud phone and adjusting its settings.

[0144] During the startup process, the application-side processor also transmits the acquired camera information and point information back to the cloud phone device for further processing and adjustment. At the same time, the display module uses the received operating screen information for display and is able to receive and display point information. This process ensures smooth data transmission from the cloud phone to the application device and realizes efficient image display and real-time adjustment. Ultimately, this integrated mechanism ensures the instant processing and feedback of camera information, optimizes the user experience, and enables the application device to accurately display images from the cloud and adjust settings.

[0145] As one implementation method, the application-side processor further includes:

[0146] Obtain camera adjustment parameters, adjust the camera according to the camera adjustment parameters, and obtain updated camera information.

[0147] The application-side processor adjusts the camera according to the camera adjustment parameters, including:

[0148] Modify the camera according to the focal length information, brightness information and contrast information in the camera adjustment parameters.

[0149] Specifically, after receiving the camera adjustment parameters, the embodiment of the present application changes the relevant data of the camera.

[0150] When clicking the camera on the desktop, the app should set the camera to default mode, enabling standard resolution and frame rate, typically HD resolution such as 1080p and 30fps, to ensure moderate and smooth capture quality. At the same time, the app should provide basic focus and exposure settings, and avoid excessive special effects or filters, to accommodate general capture needs.

[0151] In another implementation, when the live streaming software activates the live streaming function and the camera is turned on, the application device needs to adjust the camera parameters to optimize the quality of the live streaming. This includes increasing the frame rate, such as 60fps, and the resolution, such as 720p or 1080p, and applying a lower compression rate to ensure a clear and smooth image. It also enables autofocus and autoexposure to prevent image quality degradation due to lighting changes.

[0152] As another implementation, in the case of face recognition, in an environment with sufficient lighting, the application device should adjust the camera to enable high-definition resolution, such as 1080p, and a higher frame rate, such as 30fps, in order to accurately capture facial features.

[0153] As another implementation, in the case of face recognition in a low-light environment, the resolution should be reduced to, for example, 720p, the ISO setting should be increased, and the night vision mode or low-light filter should be enabled to improve the accuracy of face recognition.

[0154] As another embodiment, in the case of face recognition, especially face recognition in motion, a higher frame rate, such as 60fps, and a fast focus mode are used to cope with fast-moving faces and reduce blur.

[0155] Alternatively, in the case of video calls, the device should be set to a medium resolution, such as 720p, with a frame rate of 30fps to ensure good video quality and smoothness. At the same time, autofocus and auto-exposure functions should be enabled to adapt to the user's different positions and lighting conditions during the call.

[0156] As another implementation, in the case of camera-based virtual reality applications, high resolution, such as 1080p or higher, and high frame rate, such as 60fps or higher, are required to provide a clear and smooth virtual reality experience. Wide-angle mode or fisheye lens effects are also required to expand the field of view and enhance immersion.

[0157] As one implementation method, the application-side processor further includes:

[0158] The camera information is encoded and processed, and the encoded camera information is transmitted to the cloud phone device.

[0159] Specifically, the application-side processor transmits the encoded camera information to the cloud phone device including:

[0160] According to the RTMP transmission protocol, the encoded camera information is transmitted to the cloud mobile device.

[0161] Specifically, the application-side processor in this embodiment of the application first encodes the raw video data obtained from the camera. This process involves converting the video signal into a compressed format to reduce the amount of data and improve transmission efficiency. Common video encoding formats include H.264 or H.265. The purpose of encoding is to reduce bandwidth requirements and storage space usage while ensuring video quality.

[0162] Among them, Real-Time Messaging Protocol, RTMP, is a protocol used for audio and video streaming transmission. RTMP is designed to support low-latency and efficient data stream transmission and is usually used for live broadcast and real-time video transmission.

[0163] The encoded camera information is packaged into RTMP stream data packets, which contain video frames, audio frames, and some control information, such as flow control and synchronization information. The packaged data conforms to the requirements of the RTMP protocol, which improves the compatibility and stability of network transmission.

[0164] The application-side processor establishes a persistent connection with the cloud phone device using the RTMP protocol. RTMP connections typically use TCP to ensure reliable and sequential data transmission. When establishing a connection, the application-side processor sends the cloud phone device streaming metadata, such as video resolution and frame rate, as well as necessary authentication information.

[0165] Once the RTMP connection is established, the application processor begins transmitting the encoded camera information to the cloud phone device in real time as an RTMP stream. Data packets are sent according to the RTMP protocol format, improving the continuity and stability of the video stream. RTMP supports real-time streaming, allowing the cloud phone device to instantly receive video data and process or display it.

[0166] After receiving the RTMP stream, the cloud phone device decodes the compressed data and restores it to the original video signal. The decoded video signal is processed into the running screen information on the cloud phone device for further processing and storage. The cloud phone device may further process the received video stream, such as applying filters, adjusting image settings, or streaming it. Ultimately, users can view the content captured by the camera in real time.

[0167] Throughout this process, the application-side processor encodes the camera feed and transmits it to the cloud phone via the RTMP protocol. The RTMP protocol ensures low latency and efficient data transmission, enabling the video stream to be displayed or processed in real time on the cloud phone. This method is highly effective in real-time video transmission scenarios, such as live streaming, video conferencing, and virtual reality applications.

[0168] The embodiment of the present application may also adopt the WebRTC transmission protocol.

[0169] WebRTC, or Web Real-Time Communication, is a technology that enables real-time audio, video, and data exchange through web browsers or mobile applications. It enables web applications to directly conduct high-quality audio and video calls, transfer files, and share data, providing users with a rich, real-time interactive experience.

[0170] The present application embodiment provides a data processing method, which is applied to the above application device. The application-side processor performs the following steps:

[0171] By obtaining the startup information, sending the startup information to the cloud phone device to start the virtual cloud phone, and sending the camera information and point information to the cloud phone device for adjustment.

[0172] As one implementation method, it also includes:

[0173] Obtain camera adjustment parameters, adjust the camera according to the camera adjustment parameters, and obtain updated camera information.

[0174] As one implementation method, it also includes:

[0175] Modify the camera according to the focal length information, brightness information and contrast information in the camera adjustment parameters.

[0176] As one implementation method, it also includes:

[0177] The camera information is encoded and processed, and the encoded camera information is transmitted to the cloud phone device.

[0178] Specifically, during the startup process of the embodiment of the present application, the application-side processor will transmit the acquired camera information and point information back to the cloud phone device for further processing and adjustment. At the same time, the display module uses the received operating screen information for display, and is able to receive and display point information. This process enables smooth data transmission from the cloud phone to the application device, and realizes efficient screen display and real-time adjustment. Ultimately, this integration mechanism ensures the immediate processing and feedback of camera information, optimizes the user experience, and enables the application device to accurately display the images from the cloud and adjust the settings.

[0179] Reference Figure 1 , an embodiment of the present application provides a camera call system, the system comprising:

[0180] The cloud phone device obtains the startup information and point information of the application device through the cloud phone data acquisition module;

[0181] The cloud phone device obtains a virtual cloud phone according to the startup information through the cloud phone processor, adjusts the virtual cloud phone according to the point information, obtains the operation screen information, and transmits the operation screen information to the corresponding application device;

[0182] The cloud phone processor triggers the operation through the current running state of the virtual cloud phone and the obtained point information. When the trigger result of the point information corresponding to the current running state is to start shooting, the camera call instruction is sent to obtain the camera information, and the adjusted running screen information is obtained according to the camera information.

[0183] The application device receives the camera call instruction and running screen information sent by the cloud phone processor through the application-side data receiving module;

[0184] The application device is used to shoot through a camera to obtain camera information;

[0185] The application device displays the operation screen information through the display module and receives the point information;

[0186] The application device activates the camera according to the camera call instruction through the application-side processor and sends information to the cloud phone device for activation and adjustment;

[0187] Among them, the application-side processor obtains the startup information, sends the startup information to the cloud phone device to start the virtual cloud phone, and sends the camera information and point information to the cloud phone device for adjustment.

[0188] Specifically, the present application obtains startup information through the application device and transmits the startup information to the cloud phone data acquisition module. The cloud phone processor constructs a virtual cloud phone corresponding to the application device according to the startup information, and transmits the obtained operation screen information to the display module. The application device displays the operation screen information through the display module, and inputs the point information through the display module, and transmits the point information to the cloud phone device. The cloud phone processor triggers the operation through the current operation status of the virtual cloud phone and the obtained point information. When the trigger result of the point information corresponding to the current operation status is to start shooting, a camera call instruction is sent. After receiving the camera call instruction, the camera of the application device starts the camera for shooting. The camera adjusts and pre-adjusts different parameters according to different camera call instructions, and transmits the camera information to the cloud phone processor for processing, obtains the adjusted operation screen information, and transmits it back to the application device for display, so that the cloud phone can normally operate camera-related applications and improve the user experience of the cloud phone.

[0189] As one implementation method, the embodiment of the present application first starts a virtual cloud phone. The user starts the virtual cloud phone application on a client device such as a computer, tablet or physical phone, connects to the cloud server to run the virtual phone instance.

[0190] Requesting camera access. In a virtual cloud phone, a user launches an application that requires camera access, such as a video call application. The application initiates a camera access request to the virtual cloud phone operating system.

[0191] Send control commands. The virtual cloud phone operating system sends camera control commands over the network. These commands are transmitted to the physical device via a predefined protocol and are received and interpreted by the camera on the physical device.

[0192] Camera control module: After receiving the control command, the camera control module on the physical device starts the physical camera and prepares to start video data collection.

[0193] Data acquisition: The physical device's camera begins collecting video data and performs preliminary processing on the real-time video stream through the data acquisition module.

[0194] Data encoding. The data acquisition module passes the video data to the encoding module for encoding. The encoded data is formatted into data packets suitable for network transmission.

[0195] Video data transmission: The physical device sends the encoded video data to the virtual cloud phone through the network using optimized transmission protocols such as RTMP and WebRTC.

[0196] Data reception and decoding: The virtual cloud phone receives video data from the physical device and decodes the video data through the decoding module, converting it into displayable image data.

[0197] Video display. The decoded real-time video stream is displayed in the application interface of the virtual cloud phone, allowing users to watch the images captured by the physical device camera in real time.

[0198] Interaction and control. Users can perform further operations through the application in the virtual cloud phone, such as adjusting camera settings, zoom, brightness, contrast, etc., taking photos or recording videos. These operation instructions are again transmitted to the physical device through the network and executed by the camera control module.

[0199] Finally, the user ends the camera access. The virtual cloud phone sends a camera shutdown command to the physical device. The physical device shuts down the camera and stops collecting, encoding, and transmitting video data.

[0200] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and products can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0201] In several embodiments provided in this application, it should be understood that the disclosed methods, systems, devices, and program products may be implemented in other ways.

[0202] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0203] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A cloud phone device, characterized in that: include: The cloud phone data acquisition module is used to obtain the startup information and point information of the application device; A cloud phone processor, used to obtain a virtual cloud phone according to the startup information, adjust the virtual cloud phone according to the point information, obtain operation screen information, and transmit the operation screen information to a corresponding application device; Among them, the cloud phone processor triggers the operation through the current operating status of the virtual cloud phone and the obtained point information. When the trigger result of the point information corresponding to the current operating status is to start shooting, it sends a camera call instruction to obtain the camera information, and obtains the adjusted operating screen information based on the camera information.

2. The cloud phone device according to claim 1, characterized in that: The cloud phone processor also includes: When the trigger result of the point information corresponding to the current operating state is to start shooting, the corresponding camera adjustment parameters are matched through the current operating state, and the camera adjustment parameters are sent to the corresponding application device.

3. The cloud phone device according to claim 2, characterized in that: The cloud phone processor also includes: Used to obtain historical information of adjustment parameters and time point information corresponding to the historical information of adjustment parameters, analyze the historical information of adjustment parameters and the time point information, and obtain model analysis results; The application startup probability threshold is obtained, and the model analysis result is compared with the application startup probability threshold. When the model analysis result is greater than the application startup probability threshold, the corresponding camera adjustment parameter is matched.

4. The cloud phone device according to claim 3, characterized in that: The cloud phone processor also includes: In a preset time interval, and when several model analysis results are all greater than the application startup probability threshold, the model analysis result with the largest value is taken to match the camera adjustment parameters.

5. The cloud phone device according to claim 1, characterized in that: The cloud phone processor also includes: The running picture information is encoded and transmitted to the corresponding application device.

6. A data processing method, characterized in that: Applied to the cloud phone device according to any one of claims 1 to 5, the cloud phone processor performs the following steps: The trigger operation is performed through the current running status of the virtual cloud phone and the obtained point information. When the trigger result of the point information corresponding to the current running status is to start shooting, the camera call instruction is sent to obtain the camera information, and the adjusted running screen information is obtained according to the camera information.

7. The data processing method according to claim 6, characterized in that: Also includes: When the trigger result of the point information corresponding to the current operating state is to start shooting, the corresponding camera adjustment parameters are matched by the current operating state, and the camera adjustment parameters are sent to the corresponding application device.

8. The data processing method according to claim 7, characterized in that: Also includes: Acquire historical information of adjustment parameters and time point information corresponding to the historical information of adjustment parameters, analyze the historical information of adjustment parameters and the time point information, and obtain model analysis results; The application startup probability threshold is obtained, and the model analysis result is compared with the application startup probability threshold. When the model analysis result is greater than the application startup probability threshold, the corresponding camera adjustment parameter is matched.

9. The data processing method according to claim 8, characterized in that: Also includes: In a preset time interval, and when several model analysis results are all greater than the application startup probability threshold, the model analysis result with the largest value is taken to match the camera adjustment parameters.

10. The data processing method according to claim 6, characterized in that: Also includes: The running picture information is encoded and transmitted to the corresponding application device.

11. An application device, characterized in that: include: The application-side data receiving module is used to receive the camera call instructions and running screen information sent by the cloud phone processor; A camera is used to take pictures and obtain video information; Display module, used to display according to the running screen information and receive point information; The application-side processor is used to start the camera according to the camera call instruction and send information to the cloud phone device for startup and adjustment; Among them, the application-side processor obtains the startup information, sends the startup information to the cloud phone device to start the virtual cloud phone, and sends the camera information and point information to the cloud phone device for adjustment.

12. The application device according to claim 11, characterized in that: The application-side processor also includes: Obtain camera adjustment parameters, adjust the camera according to the camera adjustment parameters, and obtain updated camera information.

13. The application device according to claim 12, characterized in that: The application-side processor adjusts the camera according to the camera adjustment parameter, including: The camera is modified according to the focal length information, brightness information and contrast information in the camera adjustment parameters.

14. The application device according to claim 11, characterized in that: The application-side processor also includes: The camera information is encoded and processed, and the encoded camera information is transmitted to the cloud phone device.

15. The application device according to claim 14, characterized in that: The application-side processor transmits the encoded camera information to the cloud phone device including: According to the RTMP transmission protocol, the encoded camera information is transmitted to the cloud phone device.

16. A data processing method, characterized in that: Applied to the application device according to any one of claims 11 to 15, the application-side processor performs the following steps: By obtaining the startup information, sending the startup information to the cloud phone device to start the virtual cloud phone, and sending the camera information and point information to the cloud phone device for adjustment.

17. The data processing method according to claim 16, characterized in that: Also includes: Obtain camera adjustment parameters, adjust the camera according to the camera adjustment parameters, and obtain updated camera information.

18. The data processing method according to claim 17, characterized in that: Also includes: The camera is modified according to the focal length information, brightness information and contrast information in the camera adjustment parameters.

19. The data processing method according to claim 16, characterized in that: Also includes: The camera information is encoded and processed, and the encoded camera information is transmitted to the cloud phone device.

20. A camera call system, characterized in that: include: The cloud phone device obtains the startup information and point information of the application device through the cloud phone data acquisition module; The cloud phone device obtains a virtual cloud phone according to the startup information through the cloud phone processor, adjusts the virtual cloud phone according to the point information, obtains the operation screen information, and transmits the operation screen information to the corresponding application device; The cloud phone processor performs a trigger operation through the current running state of the virtual cloud phone and the acquired point information. When the trigger result of the point information corresponding to the current running state is to start shooting, a camera call instruction is sent to acquire the camera information, and the adjusted running screen information is obtained according to the camera information. The application device receives the camera call instruction and operation screen information sent by the cloud phone processor through the application end data receiving module; The application device uses a camera to shoot and obtain camera information; The application device displays the operation screen information through the display module and receives the point information; The application device activates the camera according to the camera call instruction through the application-side processor, and sends information to the cloud phone device for activation and adjustment; Among them, the application-side processor obtains the startup information, sends the startup information to the cloud phone device to start the virtual cloud phone, and sends the camera information and point information to the cloud phone device for adjustment.

Images