Information processing method and related product
By using screen projection and rendering technology between in-vehicle devices and terminal devices, the problem of in-vehicle devices being unable to obtain detailed information about audio applications has been solved, enabling the display of detailed audio information and cross-device control, thus improving user experience and security.
Patent Information
- Application Number
- CN202110995664.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-08-27
- Publication Date
- 2025-11-11
- Estimated Expiration
- 2041-08-27
AI Technical Summary
In-vehicle devices cannot access detailed information about audio applications on terminal devices, resulting in a rudimentary user interface, reduced screen utilization, and compromised driving safety.
The in-vehicle device establishes a screen projection connection with the terminal device, receives and renders the media data from the terminal device, generates projection data and displays detailed audio information, thereby achieving cross-terminal control and rendering.
It enhances the richness of interactive content on in-vehicle terminals, making it easier for users to obtain detailed audio information, thereby improving user experience and driving safety.
Smart Images

Figure CN115942016B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of information processing technology, specifically to an information processing method and related products. Background Technology
[0002] Currently, most in-vehicle devices have the function of playing Bluetooth music. However, when casting audio applications from a terminal device to an in-vehicle device, due to application incompatibility or system permission restrictions, the in-vehicle device cannot obtain detailed information about the playback content in the audio application, such as song title, artist information, playback progress, or lyrics. The in-vehicle device's interface only displays the audio playback interface set by the system. If users need to obtain more detailed audio information, they need to obtain it from a mobile phone with a smaller screen, which reduces the utilization rate of the in-vehicle screen and is also detrimental to driving safety. Summary of the Invention
[0003] This application provides an information processing method and related products. After establishing an audio transmission connection with a terminal device, the vehicle-mounted device can not only play the audio from the terminal device, but also obtain and display detailed audio information from the terminal device, making it convenient for users to obtain audio information and enhancing the richness of interactive content on the vehicle-mounted terminal.
[0004] The first aspect of this application provides an information processing method applied to an in-vehicle device, wherein the in-vehicle device establishes a screen projection connection with a terminal device, comprising the following steps:
[0005] Receive media data sent by a terminal device, wherein the media data originates from a first application in the terminal device;
[0006] The media data is sent to the terminal device so that a second application on the terminal device can generate screen projection data based on the media data.
[0007] Receive screen projection data sent by the terminal device;
[0008] Based on the screen projection data and the media data, the target page corresponding to the first application is rendered in a preset page.
[0009] A second aspect of this application provides an information processing method applied to a terminal device.
[0010] The terminal device is connected to the in-vehicle device for screen projection. The terminal device includes a first application and a second application, and includes the following steps:
[0011] In response to a media data control command triggered by a user for a first application, the media data is sent to the in-vehicle device;
[0012] Receive the media data sent by the vehicle-mounted device;
[0013] According to the second application, configure the media data to generate corresponding screen casting data;
[0014] The projection data is sent to the vehicle-mounted device.
[0015] A third aspect of this application provides an information processing apparatus applied to an in-vehicle device, wherein the in-vehicle device establishes a screen projection connection with a terminal device, and the apparatus includes: a receiving unit, a sending unit, and a rendering unit, wherein...
[0016] The receiving unit is used to receive media data sent by the terminal device, wherein the media data originates from a first application in the terminal device;
[0017] The sending unit is used to send the media data to the terminal device, so that the second application on the terminal device can generate screen projection data based on the media data;
[0018] The receiving unit is also used to receive screen projection data sent by the terminal device;
[0019] The rendering unit is used to render the target page corresponding to the first application in a preset page based on the projection data and the media data.
[0020] A fourth aspect of this application provides an information processing apparatus applied to a terminal device, wherein the terminal device is connected to an in-vehicle device for screen projection, the terminal device includes a first application and a second application, and the apparatus includes: a sending unit, a determining unit, and a sending unit, wherein...
[0021] The sending unit is configured to send the media data to the vehicle-mounted device in response to a media data control command triggered by the user for the first application;
[0022] The receiving unit is used to receive the media data sent by the vehicle-mounted device;
[0023] The configuration unit is configured to configure the media data according to the second application to generate corresponding screen casting data;
[0024] The sending unit is also used to send the projection data to the vehicle-mounted device.
[0025] A fifth aspect of this application provides an in-vehicle device, including: a processor and a memory; and one or more programs stored in the memory and configured to be executed by the processor, the programs including instructions for some or all of the steps as described in the first aspect.
[0026] A sixth aspect of this application provides a terminal device, including: a processor and a memory; and one or more programs stored in the memory and configured to be executed by the processor, the programs including instructions for some or all of the steps as described in the second aspect.
[0027] A seventh aspect of this application provides a computer-readable storage medium for storing a computer program that causes a computer to perform some or all of the steps described in the first or second aspect of this application.
[0028] An eighth aspect of this application provides a computer program product, comprising a non-transitory computer-readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps described in the first or second aspect of this application. The computer program product may be a software installation package.
[0029] Implementing the embodiments of this application has the following beneficial effects:
[0030] As can be seen, through the information processing method and related products described in the embodiments of this application, the terminal device responds to the media data control command triggered by the user for the first application and sends media data to the in-vehicle device. The in-vehicle device receives the media data sent by the terminal device, wherein the media data originates from the first application in the terminal device. The in-vehicle device sends the media data to the terminal device so that the second application on the terminal device generates projection data based on the media data. The terminal device receives the media data sent by the in-vehicle device, configures the media data according to the second application to generate corresponding projection data, and sends the projection data to the in-vehicle device. The in-vehicle device receives the projection data sent by the terminal device; the in-vehicle device renders the target page corresponding to the first application in a preset page based on the projection data and the media data. In this way, the terminal device can avoid the situation where it cannot control the media data due to the inability of applications to obtain relevant data information, and can realize the control requirements of the terminal device for media data when projection is performed across devices, which is beneficial to improving the user experience; and the in-vehicle device can render the media data according to the second application, thereby realizing the projection of the media data corresponding to the first application in the terminal device. Furthermore, after establishing an audio transmission connection with the terminal device, the in-vehicle device can not only play the audio from the terminal device, but also obtain and display detailed audio information from the terminal device, making it convenient for users to obtain audio information and enhancing the richness of interactive content on the in-vehicle terminal. Attached Figure Description
[0031] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0032] Figure 1A This is a schematic diagram of the architecture of an information processing system provided in an embodiment of this application;
[0033] Figure 1B This is a schematic flowchart of an embodiment of an information processing method provided in this application;
[0034] Figure 2 This is a schematic flowchart of an embodiment of an information processing method provided in this application;
[0035] Figure 3A This is a schematic flowchart of an embodiment of an information processing method provided in this application;
[0036] Figure 3B This is an interactive schematic diagram of an information processing method provided in an embodiment of this application;
[0037] Figure 4 This is a schematic diagram of an embodiment of an information processing device provided in this application.
[0038] Figure 5 This is a schematic diagram of an embodiment of an information processing device provided in this application.
[0039] Figure 6 This is a schematic diagram of the structure of an embodiment of a vehicle-mounted device provided in this application;
[0040] Figure 7 This is a schematic diagram of the structure of an embodiment of a terminal device provided in this application. Detailed Implementation
[0041] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0042] The terms "first," "second," "third," and "fourth," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.
[0043] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The presentation of this phrase in various locations throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.
[0044] To better understand the information processing method and related products provided in the embodiments of this application, the system architecture of the information processing method applicable to the embodiments of this application will be described below.
[0045] Please see Figure 1A , Figure 1A This is a schematic diagram of the architecture of the information processing system provided in an embodiment of this application. Figure 1A As shown, the system architecture may include in-vehicle equipment and terminal equipment, and the terminal equipment and in-vehicle equipment may establish Bluetooth communication or wireless communication connection.
[0046] In this embodiment, the aforementioned vehicle-mounted device or terminal device may be a portable terminal device that also includes other functions such as a personal digital assistant and / or music player, such as a mobile phone, tablet computer, or wearable terminal device with wireless communication capabilities (such as a smartwatch). Exemplary embodiments of the portable terminal device include, but are not limited to, portable terminal devices running iOS, Android, Microsoft, or other operating systems. The aforementioned portable terminal device may also be other portable terminal devices, such as a laptop computer.
[0047] As can be seen, in this embodiment, the terminal device responds to a media data control command triggered by the user for the first application and sends media data to the in-vehicle device. The in-vehicle device receives the media data sent by the terminal device, wherein the media data originates from the first application in the terminal device. The in-vehicle device sends the media data to the terminal device so that the second application on the terminal device generates projection data based on the media data. The terminal device receives the media data sent by the in-vehicle device, configures the media data according to the second application to generate corresponding projection data, and sends the projection data to the in-vehicle device. The in-vehicle device receives the projection data sent by the terminal device; based on the projection data and the media data, the in-vehicle device renders the target page corresponding to the first application in a preset page. In this way, terminal devices can avoid situations where they cannot control media data due to the inability of applications to obtain relevant data information. This enables terminal devices to control media data during cross-device screen mirroring, which is beneficial to improving user experience. Furthermore, the in-vehicle device can render media data based on the second application, thereby enabling screen mirroring of media data corresponding to the first application on the terminal device. Moreover, after establishing an audio transmission connection with the terminal device, the in-vehicle device can not only play the audio from the terminal device, but also obtain and display detailed audio information from the terminal device, making it convenient for users to obtain audio information and enhancing the richness of interactive content on the in-vehicle terminal.
[0048] Please see Figure 1B This is a flowchart illustrating an embodiment of an information processing method provided in this application. Applied to in-vehicle devices, in this embodiment the in-vehicle infotainment system (IVR) is a device installed inside a car. The IVR enables communication between people and the car, and between the car and the outside world. The terminal device is a mobile phone. The information processing method described in this embodiment includes the following steps:
[0049] 101. The vehicle-mounted device receives media data sent by the terminal device, wherein the media data originates from a first application in the terminal device.
[0050] The aforementioned vehicle-mounted equipment can communicate with terminal devices, specifically through Bluetooth, USB data transmission, or wireless network protocols.
[0051] The aforementioned first application is installed on the terminal device, and this first application may include audio applications. The aforementioned media data originates from this first application, and this media data may include the song being played, the song title, lyrics, the singer, etc., which are not limited here.
[0052] The in-vehicle device can receive a screen projection command from the terminal device after establishing a Bluetooth communication connection with the terminal device; and receive media data sent by the terminal device according to the Bluetooth data transmission channel corresponding to the Bluetooth communication connection.
[0053] 102. The vehicle-mounted device sends the media data to the terminal device, so that the second application on the terminal device generates screen projection data based on the media data.
[0054] 103. The vehicle-mounted device receives the screen projection data sent by the terminal device.
[0055] The second application, installed on the terminal device, differs from the first application and is primarily used for screen projection. In this embodiment, the second application is a vehicle-to-everything (V2X) application developed based on in-vehicle equipment, enabling data interaction between the terminal device and the in-vehicle equipment.
[0056] In this case, incompatibility may occur between the in-vehicle device and the terminal device due to differences in operating systems. That is, after media data from the first application is transmitted to the in-vehicle device, the in-vehicle device may not be able to perform the functions corresponding to the first application, such as music playback. Therefore, in this embodiment, the in-vehicle device receives the media data sent by the first application in the terminal device via a Bluetooth data transmission channel, and then sends the media data back to the second application in the terminal device. The second application analyzes the media data to obtain projection data, and then transmits the projection data and the media data to the in-vehicle device, so that the media data is displayed on the in-vehicle device's screen.
[0057] The aforementioned projection data is generated by the second application based on the aforementioned media data. The projection data includes rendering data, page layout rules, etc. The in-vehicle device generates a display interface based on the projection data and media data, so that the interactive interface of the in-vehicle device displays the aforementioned media data in the display mode of the second application.
[0058] 104. The in-vehicle device renders the target page corresponding to the first application in a preset page based on the screen projection data and the media data.
[0059] The preset page can be set by the user or be the system default; no specific limitation is made here. This preset page can be specified in the in-vehicle device, or it can be generated in real-time in the background after the in-vehicle device receives the screen mirroring command sent by the terminal device. This preset page can refer to the page preset in the in-vehicle device before screen mirroring is implemented based on the aforementioned screen mirroring data and media data.
[0060] The projection data includes rendering data, which includes at least one of the following: image rendering data, text rendering data, style rendering data, etc., without limitation.
[0061] Optionally, the specific data in each type of the above rendering data can be referred to as a rendering element. For example, image rendering data may include multiple rendering elements, such as foreground elements and background elements, where both foreground and background elements can be composed of RGB values. Similarly, text rendering data may include multiple rendering elements, such as multiple characters, each of which can be called a rendering element.
[0062] In specific implementation, the preset page may include multiple grids, each grid corresponding to a coordinate. Rendering the target page corresponding to the first application on the preset page may include the following steps: The in-vehicle device can select multiple target grids from the multiple grids on the preset page based on the aforementioned projection data, and group the multiple grids to obtain multiple grid sets, each grid set corresponding to a rendering element. Thus, the coordinates corresponding to the rendering data in each grid set can be determined, resulting in multiple coordinate sets, each coordinate set including at least one coordinate, each coordinate corresponding to a rendering element. Finally, based on different rendering elements, data corresponding to the rendering elements can be selected from the media data to obtain multiple target data, each target data corresponding to a rendering element. Then, based on each coordinate set, the corresponding target data can be filled into or adapted to the corresponding coordinates. Finally, the aforementioned target page can be generated. This enables the projection function, allowing projection of audio applications.
[0063] In one possible example, rendering the target page corresponding to the first application on a preset page based on the projection data and the media data may include the following steps: parsing the projection data to obtain page layout rules and rendering data, wherein the rendering data includes at least one of the following: image rendering data, text rendering data, and style rendering data; parsing the media data to obtain audio data and page display data corresponding to the second application; determining the mapping relationship between the page display data and the rendering data according to the page layout rules; and rendering the target page corresponding to the first application on the preset page based on the mapping relationship, the playback data, the page display data, and the rendering data.
[0064] The aforementioned rendering data includes at least one of the following: image rendering data, text rendering data, style rendering data, etc., which are not limited here.
[0065] The aforementioned media data may include audio data and page display data corresponding to the second application. Due to limitations in the display space of the in-vehicle device or preset page display rules (e.g., larger fonts or smaller display area on preset pages compared to the terminal device), when casting media data from the second application to the in-vehicle device, the media data can be filtered to select only the most important data for casting, thus obtaining the desired page display data.
[0066] The data displayed on the aforementioned page may include at least one of the following: song title, image data, artist, lyrics, etc., without limitation.
[0067] The audio data mentioned above is different from the data displayed on the page. The audio data can refer to digitized sound data, including sound characteristics such as pitch, melody, and rhythm.
[0068] In practical implementation, the aforementioned page layout rules can be used to plan the layout of a preset page to determine the page display data corresponding to each area, thereby obtaining the mapping relationship between the page display data and the rendering data. Based on the mapping relationship and the rendering data, the page display data is rendered on the preset page accordingly. Then, based on the playback data, the corresponding audio data in the current preset page can be determined. Finally, the target page can be obtained. In this way, the screen casting function for media data in the first application on the terminal device can be realized.
[0069] Optionally, the above method may further include the following steps: filtering the page display data according to the page layout rules to obtain the page display data corresponding to each area in the preset page; determining the maximum data display volume for each area in the preset page according to the page layout rules; if the data volume of the page display data i corresponding to area i is greater than or equal to the maximum data display volume corresponding to area i, then splitting the page display data to obtain multiple sub-page display data, and rotating the multiple sub-page display data in area i at a preset speed, preset period, and preset switching method, wherein area i is one of the areas corresponding to the preset page.
[0070] In this embodiment of the application, if lyrics need to be played but the page area for displaying the lyrics is small, the lyrics can be split into multiple sub-lyrics and dynamically displayed in a carousel manner. In this way, dynamic playback of page display data such as lyrics can be achieved according to the preset page space and page display rules, which is beneficial to improving the user experience.
[0071] Optionally, after rendering the target page corresponding to the first application in the preset page, the above method may further include the following steps: in response to a control command triggered by a user on the target page, identifying the control command; if the control command is a first control command, controlling the target page; if the control command is a second control command, sending the control command to the terminal device, receiving target media data sent by the terminal device, and updating the target page according to the target media data. When a user triggers a control command on the target page, the control command is sent to a second application. After identifying the control command, the second application generates a corresponding execution command and sends the execution command to the in-vehicle device. After receiving the execution command, the in-vehicle device sends the execution command to the first application in the terminal device via a Bluetooth data transmission channel. The first application receives the execution command and processes the corresponding events according to the execution command.
[0072] Users can operate the terminal device to control the playback, switching, display, volume adjustment, and other functions of songs on the target page of the in-vehicle device.
[0073] The first control instruction differs from the second control instruction. The first control instruction can be used to control the page and does not require updating media data to achieve page control; for example, the first control instruction may include functions such as playing or pausing a song. The second control instruction can be used to control the page, but requires updating media data after page control to achieve page control; for example, the second control instruction may include switching to the next or previous song.
[0074] The aforementioned control commands include any one of the following: play song command, switch song command, pause song command, and volume control command. Of course, other control commands may also be included, which are not limited here.
[0075] As can be seen, in the embodiments of this application, it is possible to determine whether media data needs to be updated for different control commands in order to realize the control function corresponding to the control command.
[0076] Furthermore, since the two applications on the terminal device cannot access each other's data, if the aforementioned control command is a second control command, the target media data can be sent to the second application on the terminal device. Then, the terminal device can reconfigure the corresponding screen projection data for the in-vehicle device based on the target media data to obtain the target screen projection data, and send this target screen projection data to the in-vehicle device. The in-vehicle device can update the target page based on the target screen projection data to respond to the second control command. Thus, in this embodiment, the inability to control media data due to the inability of applications on the terminal device to obtain relevant data information can be avoided. This allows the terminal device to meet the control needs for media data (such as switching to the next or previous song) during screen projection, thereby improving the user experience.
[0077] As can be seen, the information processing method provided in this application, when applied to an in-vehicle device, receives media data sent by a terminal device, wherein the media data originates from a first application in the terminal device; sends the media data to the terminal device so that a second application on the terminal device generates projection data based on the media data; receives the projection data sent by the terminal device; and renders the target page corresponding to the first application in a preset page based on the projection data and the media data. Thus, the rendering of media data can be achieved based on the second application, thereby enabling the projection of media data corresponding to the first application in the terminal device.
[0078] In other embodiments, the second application may draw the image to be projected based on the media data. The image to be projected is the target page corresponding to the first application. The image to be projected is transmitted to the vehicle device as projection data via the Bluetooth data transmission channel. The vehicle device receives the projection data, forms the image, and displays it on the vehicle device display screen.
[0079] Consistent with the above, please refer to Figure 2 This is a schematic flowchart of an embodiment of an information processing method provided in this application. The information processing method described in this embodiment is applied to a terminal device, which is connected to an in-vehicle device for screen projection. The terminal device includes a first application and a second application, and includes the following steps:
[0080] 201. The terminal device responds to the media data control command triggered by the user for the first application and sends the media data to the vehicle-mounted device.
[0081] 202. The terminal device receives the media data sent by the vehicle-mounted device.
[0082] 203. The terminal device configures the media data according to the second application to generate corresponding screen projection data.
[0083] 204. The terminal device sends the projection data to the vehicle-mounted device.
[0084] The first application and the second application are different. The first application may refer to an audio application APP, and the second application can be used to draw or configure the projection data of the media data corresponding to the first application. The projection data may include rendering data, page layout rules, etc. The rendering data can be used to display the media data on the terminal device.
[0085] In this application, the user can initiate a media data control command in the second application of the terminal device. This media data control command can be used to project the screen onto the in-vehicle device. Furthermore, a communication connection can be established between the terminal device and the in-vehicle device via Bluetooth, and the media data corresponding to the media data control command can be sent to the in-vehicle device.
[0086] Since the two applications on the terminal device cannot obtain specific data, meaning the second application cannot communicate with the first application, media data can be sent to the in-vehicle device and then transmitted to the second application on the terminal device. However, because the terminal device and the in-vehicle device are incompatible, the in-vehicle device cannot render the media data to obtain the rendered target page. Therefore, the second application can configure the corresponding preset page on the in-vehicle device to obtain projection data for media rendering on the in-vehicle device. This projection data can then be sent to the in-vehicle device, which can further process cross-terminal information based on it.
[0087] In one possible example, configuring the screen casting data corresponding to the media data according to the second application may include the following steps: obtaining a preset mapping relationship between applications and screen casting data; and determining the screen casting data corresponding to the second application based on the mapping relationship.
[0088] The terminal device can store a preset mapping relationship between applications and screen projection data. This application can be not limited to audio apps, but can also be a video app. In specific implementation, the mapping relationship between applications and screen projection data can be determined based on the relationship between different applications and the configuration parameters of the vehicle device (e.g., display size, display name, display kernel type, operating system corresponding to the display, etc.). In this way, screen projection data adapted to the vehicle device can be configured.
[0089] The mapping relationship described above can be set by the user or by the system default, and is not limited here. Users can set page layout rules for the first application in the second application, or they can directly design the page UI in the second application. Then, when casting the first application to the in-vehicle device, the media data can be rendered according to the user-designed page layout rules to achieve cross-terminal casting. In this way, users can configure it according to their preferences, which helps improve the user experience.
[0090] As can be seen, the information processing method provided in this application, when applied to a terminal device, responds to a media data control command triggered by a user for a first application, sending the media data to the in-vehicle device; receiving the media data sent by the in-vehicle device; configuring the media data according to a second application to generate corresponding projection data; and sending the projection data to the in-vehicle device. This avoids the situation where control over media data cannot be achieved due to the inability of applications in the terminal device to obtain relevant data information, and enables the terminal device to meet the control needs for media data during cross-device projection, thus improving the user experience.
[0091] Consistent with the above, please refer to Figure 3A This is a schematic flowchart of an embodiment of an information processing method provided in this application. The information processing method described in this embodiment includes the following steps:
[0092] 301. The terminal device responds to the media data control command triggered by the user for the first application and sends the media data to the vehicle-mounted device.
[0093] 302. The vehicle-mounted device receives media data sent by the terminal device, wherein the media data originates from a first application in the terminal device.
[0094] 303. The vehicle-mounted device sends the media data to the terminal device, so that the second application on the terminal device generates screen projection data based on the media data.
[0095] 304. The terminal device receives the media data sent by the vehicle-mounted device.
[0096] 305. The terminal device configures the media data according to the second application to generate corresponding screen projection data.
[0097] 306. The terminal device sends the screen projection data to the vehicle-mounted device.
[0098] 307. The vehicle-mounted device receives the screen projection data sent by the terminal device.
[0099] 308. The in-vehicle device renders the target page corresponding to the first application in a preset page based on the projection data and the media data.
[0100] For a detailed description of step 301 above, please refer to Figure 2 The corresponding steps of step 201 in the described information processing method, and the detailed descriptions of steps 302-303 above, can be found in [reference needed]. Figure 1B The corresponding steps of steps 101-102 in the described information processing method, and the detailed descriptions of steps 304-306 above, can be found in [reference needed]. Figure 2 The corresponding steps 202-205 of the described information processing method, and the detailed descriptions of steps 307-308 above, can be found in [reference needed]. Figure 1B The corresponding steps of steps 103-104 of the described information processing method will not be repeated here.
[0101] For example, please refer to Figure 3B , Figure 3B This is an interactive schematic diagram of an information processing method provided in this application embodiment. As shown in the figure, the user can select whether to display the first information processing on the in-vehicle device in the application interface corresponding to the first application. If the user selects "yes", the media data can be sent to the in-vehicle device via Bluetooth. For example, if the song currently being played by the first application is "Me and My Motherland", then the media data related to the song (e.g., song name, audio data, singer, lyrics, etc.) can be sent to the in-vehicle device. After receiving the media data, the in-vehicle device can send the media data to the second application in the terminal device. The second application can configure the projection data adapted to the display of the in-vehicle device based on the media data, such as rendering data and page layout rules. Furthermore, the in-vehicle device can further render a preset page based on the media data and projection data to obtain a target page. The target page can display the media data and play the audio data through the audio output device corresponding to the in-vehicle device.
[0102] As can be seen, through the information processing method provided in this application embodiment, the terminal device responds to a media data control command triggered by the user for the first application and sends media data to the in-vehicle device. The in-vehicle device receives the media data sent by the terminal device, wherein the media data originates from the first application in the terminal device. The in-vehicle device sends the media data to the terminal device so that the second application on the terminal device generates projection data based on the media data. The terminal device receives the media data sent by the in-vehicle device, configures the media data according to the second application to generate corresponding projection data, and sends the projection data to the in-vehicle device. The in-vehicle device receives the projection data sent by the terminal device; based on the projection data and the media data, the in-vehicle device renders the target page corresponding to the first application in a preset page. In this way, terminal devices can avoid situations where they cannot control media data due to the inability of applications to obtain relevant data information. This enables terminal devices to control media data during cross-device screen mirroring, which is beneficial to improving user experience. Furthermore, the in-vehicle device can render media data based on the second application, thereby enabling screen mirroring of media data corresponding to the first application on the terminal device. After establishing an audio transmission connection with the terminal device, the in-vehicle device can not only play the audio from the terminal device, but also obtain and display detailed audio information from the terminal device, making it convenient for users to obtain audio information and enhancing the richness of interactive content on the in-vehicle terminal.
[0103] Consistent with the above, the following is an apparatus for implementing the above information processing method, specifically as follows:
[0104] Please see Figure 4 This is a schematic diagram illustrating the structure of an embodiment of an information processing device provided in this application. The information processing device described in this embodiment is applied to an in-vehicle device and includes: a receiving unit 401, a sending unit 402, and a rendering unit 403, wherein...
[0105] The receiving unit 401 is used to receive media data sent by the terminal device, wherein the media data originates from a first application in the terminal device;
[0106] The sending unit 402 is used to send the media data to the terminal device so that the second application on the terminal device can generate screen projection data based on the media data;
[0107] The receiving unit 401 is also used to receive screen projection data sent by the terminal device;
[0108] The rendering unit 403 is used to render the target page corresponding to the first application in a preset page based on the projection data and the media data.
[0109] As can be seen, the information processing apparatus described in the embodiments of this application can receive media data sent by a terminal device, wherein the media data originates from a first application in the terminal device; send the media data to the terminal device so that a second application on the terminal device generates projection data based on the media data; receive the projection data sent by the terminal device; and render the target page corresponding to the first application in a preset page based on the projection data and the media data. Thus, the rendering of media data can be achieved based on the second application, thereby enabling the projection of media data corresponding to the first application in the terminal device.
[0110] In one possible example, in rendering the target page corresponding to the first application in a preset page based on the projection data and the media data, the rendering unit 403 is specifically used for:
[0111] The screen projection data is parsed to obtain page layout rules and rendering data, wherein the rendering data includes at least one of the following: image rendering data, text rendering data, and style rendering data;
[0112] The media data is parsed to obtain the audio data and page display data corresponding to the second application;
[0113] Based on the page layout rules, determine the mapping relationship between the page display data and the rendering data;
[0114] Based on the mapping relationship, the playback data, the page display data, and the rendering data, the target page corresponding to the first application is rendered in the preset page.
[0115] In one possible example, the rendering unit 403 is further configured to:
[0116] According to the page layout rules, the page display data is filtered to obtain the page display data corresponding to each area in the preset page;
[0117] Based on the page layout rules, determine the maximum amount of data to be displayed in each area of the preset page;
[0118] If the amount of data displayed on the page corresponding to region i is greater than or equal to the maximum amount of data displayed in region i, then the page display data is split into multiple sub-page display data, and the multiple sub-page display data are rotated within region i at a preset speed, preset period and preset switching method, where region i is one of the regions corresponding to the preset page.
[0119] Please see Figure 5This is a schematic diagram of an embodiment of an information processing device provided in this application. The information processing device described in this embodiment is applied to a terminal device, which is connected to an in-vehicle device for screen projection. The terminal device includes a first application and a second application. The device includes: a sending unit 501, a determining unit 502, and a sending unit 503, wherein...
[0120] The sending unit 501 is used to send the media data to the vehicle device in response to a media data control command triggered by the user for the first application.
[0121] The receiving unit 502 is used to receive the media data sent by the vehicle-mounted device;
[0122] The configuration unit 503 is configured to configure the media data according to the second application to generate corresponding screen casting data;
[0123] The sending unit 501 is also used to send the projection data to the vehicle-mounted device.
[0124] As can be seen, the information processing device described in this application embodiment, in response to a media data control command triggered by a user for a first application, sends the media data to the in-vehicle device; receives the media data sent by the in-vehicle device; configures the media data according to the second application to generate corresponding projection data; and sends the projection data to the in-vehicle device. This avoids the situation where control of media data cannot be achieved due to the inability of applications in the terminal device to obtain relevant data information, and enables the terminal device to meet the control needs of media data during cross-device projection, thus improving the user experience.
[0125] In one possible example, regarding configuring the projection data corresponding to the media data according to the second application, the configuration unit 503 is specifically used for:
[0126] Obtain the preset mapping relationship between applications and screen projection data;
[0127] Based on the mapping relationship, determine the screen projection data corresponding to the second application.
[0128] It is understood that the functions of each program module of the information processing device in this embodiment can be specifically implemented according to the methods in the above method embodiments, and the specific implementation process can be referred to the relevant descriptions in the above method embodiments, which will not be repeated here.
[0129] Consistent with the above, please refer to Figure 6This is a schematic diagram of an embodiment of a vehicle-mounted device provided in this application. As shown, it includes a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor. In this embodiment, the programs include instructions for performing the following steps:
[0130] Receive media data sent by a terminal device, wherein the media data originates from a first application in the terminal device;
[0131] The media data is sent to the terminal device so that a second application on the terminal device can generate screen projection data based on the media data.
[0132] Receive screen projection data sent by the terminal device;
[0133] Based on the screen projection data and the media data, the target page corresponding to the first application is rendered in a preset page.
[0134] As can be seen from the vehicle-mounted equipment described in the embodiments of this application,
[0135] It can receive media data sent by a terminal device, wherein the media data originates from a first application on the terminal device; send the media data to the terminal device so that a second application on the terminal device can generate projection data based on the media data; receive the projection data sent by the terminal device; and render the target page corresponding to the first application in a preset page based on the projection data and the media data. Thus, the rendering of media data can be achieved based on the second application, thereby enabling the projection of media data corresponding to the first application on the terminal device.
[0136] In one possible example, regarding the rendering of the target page corresponding to the first application in a preset page based on the projection data and the media data, the above procedure includes instructions for performing the following steps:
[0137] The screen projection data is parsed to obtain page layout rules and rendering data, wherein the rendering data includes at least one of the following: image rendering data, text rendering data, and style rendering data;
[0138] The media data is parsed to obtain the audio data and page display data corresponding to the second application.
[0139] Based on the page layout rules, determine the mapping relationship between the page display data and the rendering data;
[0140] Based on the mapping relationship, the playback data, the page display data, and the rendering data, the target page corresponding to the first application is rendered in the preset page.
[0141] In one possible example, the above program also includes instructions for performing the following steps:
[0142] According to the page layout rules, the page display data is filtered to obtain the page display data corresponding to each area in the preset page;
[0143] Based on the page layout rules, determine the maximum amount of data to be displayed in each area of the preset page;
[0144] If the amount of data displayed on the page corresponding to region i is greater than or equal to the maximum amount of data displayed in region i, then the page display data is split into multiple sub-page display data, and the multiple sub-page display data are rotated within region i at a preset speed, preset period and preset switching method, where region i is one of the regions corresponding to the preset page.
[0145] Consistent with the above, please refer to Figure 7 This is a schematic diagram of an embodiment of a terminal device provided in this application. As shown, it includes a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor. The terminal device is connected to an in-vehicle device for screen projection. The terminal device includes a first application and a second application. In this embodiment, the program includes instructions for performing the following steps:
[0146] In response to a media data control command triggered by a user for a first application, the media data is sent to the in-vehicle device;
[0147] Receive the media data sent by the vehicle-mounted device;
[0148] According to the second application, configure the media data to generate corresponding screen casting data;
[0149] The projection data is sent to the vehicle-mounted device.
[0150] As can be seen from the terminal device described in the embodiments of this application,
[0151] In response to a user's media data control command triggered by a first application, the system sends the media data to the in-vehicle device; receives the media data sent by the in-vehicle device; configures the media data according to the second application to generate corresponding projection data; and sends the projection data to the in-vehicle device. This avoids situations where control over media data is impossible due to the inability of applications on the terminal device to obtain relevant data information, thus enabling the terminal device to meet media data control needs during cross-device projection and improving user experience.
[0152] In one possible example, regarding configuring the projection data corresponding to the media data according to the second application, the above program includes instructions for performing the following steps:
[0153] Obtain the preset mapping relationship between applications and screen projection data;
[0154] Based on the mapping relationship, determine the screen projection data corresponding to the second application.
[0155] This application also provides a computer storage medium, wherein the computer storage medium may store a program, which, when executed, includes some or all of the steps of any of the information processing methods described in the above method embodiments.
[0156] Although this application has been described herein in conjunction with various embodiments, those skilled in the art, by reviewing the accompanying drawings, disclosure, and appended claims, will understand and implement other variations of the disclosed embodiments in carrying out the claimed application. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "an" does not exclude a plurality. A single processor or other unit can implement several functions listed in the claims. While different dependent claims may recite certain measures, this does not mean that these measures cannot be combined to produce good results.
[0157] Those skilled in the art will understand that embodiments of this application can be provided as methods, apparatus (devices), or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code. The computer program may be stored / distributed in a suitable medium, provided with or as part of other hardware, or may take other distribution forms, such as via the Internet or other wired or wireless telecommunications systems.
[0158] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (devices), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable information processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable information processing apparatus, create means for implementing the functions specified in one or more blocks of the flowchart illustrations and / or one or more blocks of the block diagrams.
[0159] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable information processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means that implement the functions specified in one or more flowcharts and / or one or more block diagrams.
[0160] These computer program instructions may also be loaded onto a computer or other programmable information processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, such that the instructions, which execute on the computer or other programmable apparatus, provide steps for implementing the functions specified in one or more flowcharts and / or one or more block diagrams.
[0161] Although this application has been described in conjunction with specific features and embodiments, it is obvious that various modifications and combinations can be made thereto without departing from the spirit and scope of this application. Accordingly, this specification and drawings are merely exemplary illustrations of this application as defined by the appended claims, and are considered to cover any and all modifications, variations, combinations, or equivalents within the scope of this application. Clearly, those skilled in the art can make various alterations and modifications to this application without departing from the spirit and scope of this application. Thus, if such modifications and modifications of this application fall within the scope of the claims of this application and their equivalents, this application is also intended to include such modifications and modifications.
Claims
1. An information processing method, characterized in that, Applied to in-vehicle devices, the in-vehicle device establishes a screen projection connection with a terminal device, which includes the following steps: Receive media data sent by a terminal device, wherein the media data originates from a first application in the terminal device; The media data is sent to the terminal device so that a second application on the terminal device can generate screen projection data based on the media data. Receive screen projection data sent by the terminal device; Based on the screen projection data and the media data, a target page corresponding to the first application is rendered in a preset page. Specifically, the screen projection data is parsed to obtain page layout rules and rendering data, wherein the rendering data includes at least one of the following: image rendering data, text rendering data, and style rendering data; the media data is parsed to obtain audio data and page display data corresponding to the second application; the mapping relationship between page display data and rendering data is determined according to the page layout rules; and the target page corresponding to the first application is rendered in the preset page based on the mapping relationship, the media data, the page display data, and the rendering data. According to the page layout rules, the page display data is filtered to obtain the page display data corresponding to each area in the preset page; Based on the page layout rules, determine the maximum amount of data to be displayed in each area of the preset page; If the amount of data displayed on the page corresponding to region i is greater than or equal to the maximum amount of data displayed in region i, then the page display data is split into multiple sub-page display data, and the multiple sub-page display data are rotated within region i at a preset speed, preset period and preset switching method, where region i is one of the regions corresponding to the preset page.
2. The method according to claim 1, after rendering the target page corresponding to the first application in the preset page, the method further includes: In response to a control command triggered by a user on the target page, the control command is identified; If the control instruction is the first control instruction, then the target page is controlled; If the control command is a second control command, then the control command is sent to the terminal device, and the target media data sent by the terminal device is received, and the target page is updated according to the target media data.
3. The method according to claim 2, wherein the control command comprises: Play song command, switch song command, pause song command, or volume control command.
4. An information processing method, characterized in that, Applied to a terminal device, the terminal device being connected to an in-vehicle device for screen projection, the terminal device including a first application and a second application, comprising the following steps: In response to a media data control command triggered by a user for a first application, the media data is sent to the in-vehicle device; Receive the media data sent by the vehicle-mounted device; According to the second application, configure the media data to generate corresponding screen casting data; The screen projection data is sent to the in-vehicle device, which is used to: render a target page corresponding to the first application in a preset page based on the screen projection data and the media data; specifically, parse the screen projection data to obtain page layout rules and rendering data, wherein the rendering data includes at least one of the following: image rendering data, text rendering data, and style rendering data; parse the media data to obtain audio data and page display data corresponding to the second application; determine the mapping relationship between page display data and rendering data based on the page layout rules; and render a target page corresponding to the first application in a preset page based on the mapping relationship, the media data, the page display data, and the rendering data. Assume the target page corresponding to the first application is rendered in the page; according to the page layout rules, the page display data is filtered to obtain the page display data corresponding to each area in the preset page; according to the page layout rules, the maximum data display volume of each area in the preset page is determined; if the data volume of the page display data i corresponding to area i is greater than or equal to the maximum data display volume corresponding to area i, the page display data is split to obtain multiple sub-page display data, and the multiple sub-page display data are rotated in area i at a preset speed, preset period and preset switching method, where area i is one of the areas corresponding to the preset page.
5. The method according to claim 4, wherein configuring the projection data corresponding to the media data according to the second application includes: Obtain the preset mapping relationship between applications and screen projection data; Based on the mapping relationship, determine the screen projection data corresponding to the second application.
6. A vehicle-mounted device, characterized in that, It includes a processor and a memory, the memory being used to store one or more programs and configured to be executed by the processor, the programs including instructions for performing the steps of the method as described in any one of claims 1-3.
7. A terminal device, characterized in that, It includes a processor and a memory, the memory being used to store one or more programs and configured to be executed by the processor, the programs including instructions for performing the steps of the method as described in any one of claims 4-5.
8. A computer-readable storage medium, characterized in that, A computer program for storing electronic data interchange is provided, wherein the computer program causes a computer to perform the method as described in any one of claims 1-3.
9. A computer-readable storage medium, characterized in that, A computer program for storing electronic data interchange is provided, wherein the computer program causes a computer to perform the method as described in any one of claims 4-5.
Citation Information
Patent Citations
Screen projection method and device
CN112540736A