Data processing method and device, electronic equipment and computer readable storage medium
By acquiring vehicle driving status and audio characteristics, a lyrics movement effect is generated on the in-vehicle terminal display screen, solving the problem of monotonous lyrics display and improving the user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- BEIJING BERLIN INTERACTIVE TECH CO LTD
- Filing Date
- 2022-11-09
- Publication Date
- 2026-05-05
AI Technical Summary
The lyrics display in existing in-vehicle terminals is too simplistic and lacks appeal.
By acquiring the vehicle's driving status, including its speed and direction, the offset and direction of the target lyrics are determined. Based on these parameters, motion effects of the target lyrics on the display screen are generated. In addition, by combining the audio's rhythm, time statistics, and sound intensity, entrance and exit effects are generated.
It achieves a diversified display of lyrics that changes synchronously with the vehicle's speed and direction of movement, enhancing the fun and variety of the lyrics display and improving the driving experience.
Smart Images

Figure CN115827912B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of computer software technology, and more specifically, to a data processing method, apparatus, electronic device, and computer-readable storage medium. Background Technology
[0002] With the development of communication networks, the application of smart cockpits is becoming more and more widespread. A smart cockpit is a human-computer interaction scenario in the car cockpit. Its main purpose is to integrate driving information and entertainment information modules, and to provide users with an efficient, intuitive and futuristic driving experience by utilizing its powerful ability to process massive amounts of information data.
[0003] Taking the playback of audio and video in an in-vehicle terminal as an example, lyrics can usually be displayed on the display screen of the in-vehicle terminal in sync with the audio, providing drivers and passengers with a comfortable and convenient driving experience. However, there is a problem that the lyrics display is too simplistic. Summary of the Invention
[0004] This application provides a data processing method, apparatus, electronic device, and computer-readable storage medium, which can solve the problem of monotonous lyrics display in vehicle-mounted terminals. The technical solution is as follows:
[0005] According to one aspect of the embodiments of this application, a data processing method is provided, the method comprising:
[0006] Obtain the vehicle's driving status; wherein the driving status includes at least one of the vehicle's speed and direction of movement;
[0007] The offset of the target lyrics is obtained based on at least one of the movement speed and movement direction; wherein the target lyrics correspond to the audio being played in the vehicle's in-vehicle terminal.
[0008] The motion effects of the target lyrics on the display screen of the vehicle terminal are determined based on the offset and / or offset direction.
[0009] In one possible implementation, the above method also includes:
[0010] Get the sound intensity of the audio;
[0011] The rhythm of an audio is determined based on sound intensity; where rhythm is used to characterize the phonetic and prosodic rules of an audio.
[0012] The entrance effects on the in-vehicle terminal's display screen are determined based on the rhythm of the audio to correspond to the target lyrics.
[0013] In one possible implementation, the above method also includes:
[0014] Obtain the time statistics information for each character of the target lyrics; the time statistics information includes the timestamp of the character and the duration of the syllable;
[0015] Encode each character based on the time statistics of each character to obtain the encoded value of each character in the target lyrics;
[0016] The appearance effect of each character in the target lyrics on the vehicle terminal's display screen is determined based on the encoded value.
[0017] In yet another possible implementation, the above-mentioned determination of audio pitch based on sound intensity includes:
[0018] The time-domain signal of sound intensity is converted into a frequency-domain signal; the frequency-domain signal is used to characterize the volume amplitude of audio at different frequencies.
[0019] The volume amplitude is used as the pitch of the audio.
[0020] In yet another possible implementation, the aforementioned entrance effect on the in-vehicle terminal display screen, which determines the target lyrics corresponding to the audio based on phonology, includes:
[0021] The degree of fragmentation of each text image corresponding to the target lyrics is determined based on the volume amplitude; where the volume amplitude is directly proportional to the degree of fragmentation.
[0022] The text image is segmented according to its degree of fragmentation, and the process of dynamically splicing the segmented text images is used as the entrance effect for the target lyrics.
[0023] In another possible implementation, the above-mentioned motion effects for determining the target lyrics on the display screen of the vehicle terminal based on offset and / or offset direction include:
[0024] The movement distance of each text image corresponding to the target lyrics is determined based on the offset.
[0025] The direction of movement for each text image corresponding to the target lyrics is determined based on the offset direction;
[0026] Based on the movement distance and direction of each text image, the movement effect of the target lyrics is determined.
[0027] In another possible implementation, the above-mentioned encoding of each character based on the time statistics of each character to obtain the encoded value of each character in the target lyrics includes:
[0028] For each character, the timestamp and syllable duration corresponding to the character are concatenated to generate the target string of the character; the target string is used as the key, and the encoded value of the key is generated based on the preset mapping relationship.
[0029] In another possible implementation, the above-mentioned determination of the appearance effects of each character in the target lyrics on the display screen of the in-vehicle terminal based on the encoded value includes:
[0030] For each character, the disappearance duration is determined based on the encoding value; whereby the disappearance duration is used to indicate the duration of the disappearance animation after the character image is segmented.
[0031] The appearance effect is determined based on the duration of the disappearance.
[0032] According to another aspect of the embodiments of this application, a data processing apparatus is provided, the apparatus comprising:
[0033] The first acquisition module is used to acquire the driving status of the vehicle; wherein the driving status includes at least one of the vehicle's speed and direction of movement;
[0034] The second acquisition module is used to acquire at least one of the offset and offset direction of the target lyrics based on at least one of the moving speed and moving direction; wherein the target lyrics correspond to the audio being played in the vehicle's in-vehicle terminal;
[0035] The determination module is used to determine the motion effects of the target lyrics on the display screen of the vehicle terminal based on the offset and / or offset direction.
[0036] In one possible implementation, the above-mentioned device further includes an entrance effects module, used for:
[0037] Get the sound intensity of the audio;
[0038] The rhythm of an audio is determined based on sound intensity; where rhythm is used to characterize the phonetic and prosodic rules of an audio.
[0039] The entrance effects on the in-vehicle terminal's display screen are determined based on the rhythm of the audio to correspond to the target lyrics.
[0040] In one possible implementation, the above-mentioned device further includes an entrance effects module, used for:
[0041] Obtain the time statistics information for each character of the target lyrics; the time statistics information includes the timestamp of the character and the duration of the syllable;
[0042] Encode each character based on the time statistics of each character to obtain the encoded value of each character in the target lyrics;
[0043] The appearance effect of each character in the target lyrics on the vehicle terminal's display screen is determined based on the encoded value.
[0044] In yet another possible implementation, the aforementioned entrance effects module, when determining the pitch of the audio based on sound intensity, is used for:
[0045] The time-domain signal of sound intensity is converted into a frequency-domain signal; the frequency-domain signal is used to characterize the volume amplitude of audio at different frequencies.
[0046] The volume amplitude is used as the pitch of the audio.
[0047] In yet another possible implementation, the aforementioned entrance effects module, when determining the entrance effects for the target lyrics corresponding to the audio on the in-vehicle terminal's display screen based on the melody, is used for:
[0048] The degree of fragmentation of each text image corresponding to the target lyrics is determined based on the volume amplitude; where the volume amplitude is directly proportional to the degree of fragmentation.
[0049] The text image is segmented according to its degree of fragmentation, and the process of dynamically splicing the segmented text images is used as the entrance effect for the target lyrics.
[0050] In another possible implementation, the aforementioned determining module, when determining the motion effects of the target lyrics on the display screen of the vehicle terminal based on the offset and / or offset direction, is used to:
[0051] The movement distance of each text image corresponding to the target lyrics is determined based on the offset.
[0052] The direction of movement for each text image corresponding to the target lyrics is determined based on the offset direction;
[0053] Based on the movement distance and direction of each text image, the movement effect of the target lyrics is determined.
[0054] In another possible implementation, when the aforementioned entrance effect module encodes each character based on the time statistics of each character to obtain the encoded value of each character in the target lyrics, it is used for:
[0055] For each character, the timestamp and syllable duration corresponding to the character are concatenated to generate the target string of the character; the target string is used as the key, and the encoded value of the key is generated based on the preset mapping relationship.
[0056] In another possible implementation, the aforementioned entrance effects module, when determining the entrance effects for each character in the target lyrics on the in-vehicle terminal's display screen based on the encoded values, is used to:
[0057] For each character, the disappearance duration is determined based on the encoding value; whereby the disappearance duration is used to indicate the duration of the disappearance animation after the character image is segmented.
[0058] The appearance effect is determined based on the duration of the disappearance.
[0059] According to another aspect of the present application, an electronic device is provided, comprising: a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the steps of the method shown in the first aspect of the present application.
[0060] According to another aspect of the embodiments of this application, a computer-readable storage medium is provided, on which a computer program is stored, which, when executed by a processor, implements the steps of the method shown in the first aspect of the embodiments of this application.
[0061] According to one aspect of the present application, a computer program product is provided, which includes a computer program that, when executed by a processor, implements the steps of the method shown in the first aspect of the present application.
[0062] The beneficial effects of the technical solutions provided in this application are:
[0063] This application embodiment detects the vehicle's driving status, obtains the vehicle's speed and direction of movement, and determines the target lyrics of the audio being played on the vehicle's in-vehicle terminal. Then, based on the speed and direction of movement, it obtains the offset and direction of the target lyrics, and further determines the motion effect of the target lyrics on the in-vehicle terminal's display screen based on at least one of the offset and direction of movement. This application embodiment determines the motion effect of the target lyrics on the display screen based on the vehicle's driving status, achieving a motion effect where the target lyrics change synchronously with the vehicle's speed and direction of movement, enhancing the fun and diversity of the lyrics display, and effectively improving the driving experience. Attached Figure Description
[0064] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments of this application will be briefly introduced below.
[0065] Figure 1 This is a schematic diagram illustrating an application scenario of a data processing method provided in an embodiment of this application;
[0066] Figure 2 A flowchart illustrating a data processing method provided in an embodiment of this application;
[0067] Figure 3 A flowchart illustrating the process of determining the pitch of audio in a data processing method provided in an embodiment of this application;
[0068] Figure 4 This is a schematic diagram illustrating the process of displaying lyrics as an entrance effect in a data processing method provided in an embodiment of this application.
[0069] Figure 5A schematic flowchart illustrating an example data processing method provided in an embodiment of this application;
[0070] Figure 6 This is a schematic diagram of the structure of a data processing device provided in an embodiment of this application;
[0071] Figure 7 This is a schematic diagram of the structure of a data processing electronic device provided in an embodiment of this application. Detailed Implementation
[0072] The embodiments of this application are described below with reference to the accompanying drawings. It should be understood that the embodiments described below with reference to the accompanying drawings are exemplary descriptions for explaining the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions of the embodiments of this application.
[0073] Those skilled in the art will understand that, unless specifically stated otherwise, the singular forms “a,” “an,” “the,” and “the” used herein may also include the plural forms. It should be further understood that the terms “comprising” and “including” as used in embodiments of this application mean that the corresponding feature can be implemented as the presented feature, information, data, step, operation, element, and / or component, but do not exclude implementation as other features, information, data, step, operation, element, component, and / or combinations thereof supported by the art. It should be understood that when we say that an element is “connected” or “coupled” to another element, the one element can be directly connected or coupled to the other element, or it can mean that the one element and the other element establish a connection relationship through an intermediate element. Furthermore, “connected” or “coupled” as used herein can include wireless connection or wireless coupling. The term “and / or” as used herein indicates at least one of the items defined by the term; for example, “A and / or B” can be implemented as “A,” or as “B,” or as “A and B.”
[0074] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.
[0075] With the development of artificial intelligence technology, the most important aspect of the "new four modernizations" of automobiles is intelligentization, which refers to the intelligentization of the entire vehicle. Besides autonomous driving, the core of this intelligentization is the intelligent cockpit. From a physical perspective, the intelligent cockpit encompasses all modules that provide drivers and passengers with a safer, more comfortable, and intelligent driving experience, including the control system, entertainment system, air conditioning system, communication system, seating system, interaction system, and perception system.
[0076] Users can install an application on the in-vehicle terminal to play audio, which they can then control. For example, users can use the physical buttons or virtual buttons on the display screen to play, pause, and skip tracks. However, currently, song playback is done with lyrics synchronized with the audio, which lacks enjoyment.
[0077] The data processing methods, apparatus, electronic devices, and computer-readable storage media provided in this application are intended to solve the above-mentioned technical problems of the prior art.
[0078] The technical solutions of this application and their effects are described below through several exemplary embodiments. It should be noted that the following embodiments can be referenced, borrowed from, or combined with each other. Identical terms, similar features, and similar implementation steps in different embodiments will not be repeated.
[0079] like Figure 1 As shown, the data processing method of this application can be applied to... Figure 1 In the scenario shown, specifically, audio is being played in the vehicle terminal 101. The server 102 detects the vehicle's driving status to obtain the vehicle's speed and direction of movement. Then, based on the speed and direction of movement, it obtains the offset and direction of the target lyrics corresponding to the audio. Based on at least one of the offset and direction of movement, it determines a motion effect and sends the display instruction of the motion effect to the vehicle terminal 101 so that the motion effect of the target lyrics is displayed on the screen of the vehicle terminal 101.
[0080] Figure 1 In the scenario shown, the above data processing method can be performed on the server; in other scenarios, it can also be performed on the terminal.
[0081] Those skilled in the art will understand that the “terminal” used herein can be a mobile phone, tablet computer, PDA (Personal Digital Assistant), MID (Mobile Internet Device), etc.; and the “server” can be implemented using a standalone server or a server cluster composed of multiple servers.
[0082] This application provides a data processing method, such as... Figure 2 As shown, this method, which can be applied to servers or terminals used for data processing, includes:
[0083] S201, Obtain the vehicle's driving status.
[0084] The driving status includes at least one of the vehicle's speed and direction of movement. The vehicle is equipped with an intelligent cockpit system, which corresponds to an in-vehicle terminal. Users can interact with the cockpit system through the in-vehicle terminal to control the vehicle or engage in entertainment activities.
[0085] Specifically, the server or terminal used for data processing can obtain the vehicle's driving status through the vehicle's central control system, thereby obtaining the vehicle's current speed and direction of movement.
[0086] In some implementations, the terminal or server used for data processing can be connected to the vehicle's central control system via a wireless or wired network. The wired network can be Ethernet based on the IEEE 802.3 (a local area network communication standard) protocol; the wireless network can be Wi-Fi (a wireless communication technology) based on the IEEE 802.11 (a wireless network communication standard) protocol.
[0087] In other implementations, the terminal or server used for data processing can be integrated into the vehicle's central control system.
[0088] S202, obtain at least one of the offset and offset direction of the target lyrics based on at least one of the movement speed and movement direction.
[0089] The target lyrics correspond to the audio being played on the vehicle's in-vehicle terminal. The vehicle's direction of movement can include the direction of acceleration, which includes forward, backward, left, and right directions. The offset direction of the target lyrics includes upward, downward, left, and right directions on the in-vehicle terminal's display screen.
[0090] Specifically, the server or terminal used for data processing can pre-construct a fitting function for the vehicle's speed, acceleration, and the offset of the target lyrics. Then, based on the vehicle's real-time speed and acceleration, the offset of the target lyrics is calculated using the fitting function, and the offset direction corresponding to the vehicle's movement direction is determined. The fitting function can be used to characterize the linear relationship between the vehicle's real-time speed, acceleration, and the target offset.
[0091] In some implementations, when the vehicle's acceleration direction is forward, the corresponding offset direction can be downward as shown on the vehicle terminal display screen; when the vehicle's acceleration direction is backward, the corresponding offset direction can be upward as shown on the vehicle terminal display screen; when the vehicle's acceleration direction is leftward, the corresponding offset direction can be rightward as shown on the vehicle terminal display screen; conversely, when the vehicle's acceleration direction is rightward, the corresponding offset direction can be leftward as shown on the vehicle terminal display screen.
[0092] S203, determine the motion effects of the target lyrics on the display screen of the vehicle terminal based on the offset and / or offset direction.
[0093] The aforementioned motion effects can be animations in which the size and spacing of the text images corresponding to the target lyrics change as the vehicle moves.
[0094] Specifically, the server or terminal used for data processing can determine the moving distance and direction of each text image corresponding to the target lyrics based on the offset and offset direction, and change the size and spacing of each text image according to the above moving distance and moving direction, thereby generating a moving effect.
[0095] This application embodiment detects the vehicle's driving status, obtains the vehicle's speed and direction of movement, and determines the target lyrics of the audio being played on the vehicle's in-vehicle terminal. Then, based on the speed and direction of movement, it obtains the offset and direction of the target lyrics, and further determines the motion effect of the target lyrics on the in-vehicle terminal's display screen based on at least one of the offset and direction of movement. This application embodiment determines the motion effect of the target lyrics on the display screen based on the vehicle's driving status, achieving a motion effect where the target lyrics change synchronously with the vehicle's speed and direction of movement, enhancing the fun and diversity of the lyrics display, and effectively improving the driving experience.
[0096] This application provides a possible implementation method, and the above method further includes:
[0097] S301, acquire the sound intensity of the audio;
[0098] Among them, sound intensity can be the time-domain signal of sound, that is, a continuous signal in which sound intensity changes over time.
[0099] Specifically, the server or terminal used for data processing can directly obtain the sound intensity of the audio from the preset storage space, or it can detect the real-time sound intensity of the audio based on the sound detection device.
[0100] S302 determines the pitch of audio based on sound intensity.
[0101] Among them, phonology is used to characterize the phonetic and rhythmic patterns of audio. The phonology of audio can be a frequency domain signal of sound.
[0102] Specifically, servers or terminals used for data processing can convert sound intensity, i.e., the time-domain information of sound, into frequency-domain information and the pitch of audio based on Fourier transform.
[0103] In the embodiments of this application, a non-sine or cosine periodic signal representing sound intensity can be transformed into an infinite number of regular sine or cosine signals representing musical notes through Fourier transform. These musical notes are discrete signals.
[0104] S303, based on the rhythm, determines the entrance effect of the target lyrics corresponding to the audio on the display screen of the vehicle terminal.
[0105] The entrance effect can be an animation in which each character image corresponding to the target lyrics is gradually displayed on the screen.
[0106] Specifically, the server or terminal used for data processing can determine the degree of fragmentation of each text image corresponding to the target lyrics based on the rhythm, and then determine the entrance effect based on the degree of fragmentation; the corresponding entrance effect can be an animation that aggregates the text images after being segmented according to the degree of fragmentation into a complete text image, and then gradually displays the target lyrics.
[0107] This application provides a possible implementation method, and the above method further includes:
[0108] S401, Obtain time statistics information for each character of the target lyrics.
[0109] The time statistics include the timestamp of the text and the syllable duration. The syllable duration can be the length of the syllables occupied by the text.
[0110] S402, Encode each character based on the time statistics of each character to obtain the encoded value of each character in the target lyrics.
[0111] The encoded value mentioned above can be an MD5 (Message-Digest Algorithm) value.
[0112] MD5 is a widely used cryptographic hash function that produces a 128-bit (16-byte) hash value to ensure the integrity and consistency of transmitted information.
[0113] Specifically, each character can be encoded using a Map (an object that maps keys to values) to obtain the MD5 value of each character.
[0114] Furthermore, the server or terminal used for data processing can construct a hash table using the map interface, using the time statistics of the text as the key and the MD5 value as the corresponding value, to determine the encoded value of each character in the target lyrics.
[0115] S403 determines the appearance effect of each character in the target lyrics on the display screen of the vehicle terminal based on the encoding value.
[0116] Specifically, the server or terminal used for data processing can determine the disappearance animation of the corresponding text image based on the appearance speed and appearance direction corresponding to the encoded value, and use the disappearance animation as the appearance effect of the target lyrics on the display screen.
[0117] This application provides a possible implementation method in which each character is encoded based on the time statistics information of each character to obtain the encoded value of each character in the target lyrics, including:
[0118] For each character, the timestamp and syllable duration corresponding to the character are concatenated to generate the target string of the character; the target string is used as the key, and the encoded value of the key is generated based on the preset mapping relationship.
[0119] In this embodiment of the application, the server or terminal used for data processing can obtain the corresponding encoded value of the target string by using the MD5 generation algorithm through map mapping.
[0120] In this embodiment, each character in the target lyrics is encoded using the time statistics of each character. Due to the uniqueness of the encoded value, a variety of entrance effects can be obtained by corresponding to the encoded value, making the display of the vehicle terminal more colorful and meeting the entertainment needs of vehicle passengers.
[0121] This application provides one possible implementation method, such as... Figure 3 As shown, the above method of determining the pitch of audio based on sound intensity includes:
[0122] S501 converts the time-domain signal of sound intensity into a frequency-domain signal.
[0123] The frequency domain signal is used to characterize the volume amplitude of audio at different frequencies. The time domain signal mentioned above is the signal showing how the sound intensity of the audio changes over time.
[0124] Specifically, servers or terminals used for data processing can perform Fourier transforms on time-domain information to obtain the corresponding frequency-domain signal.
[0125] S502 uses volume amplitude as the pitch of audio.
[0126] By converting a signal to its time frequency, a time-domain signal, i.e., a non-sine / cosine periodic function, can be converted into a frequency-domain signal, i.e., a sine / cosine periodic function, corresponding to each different frequency, so as to obtain the volume amplitude corresponding to different frequencies of the audio.
[0127] This application provides a possible implementation method for the entrance effect of the target lyrics corresponding to the audio determined based on the rhythm on the display screen of the vehicle terminal, including:
[0128] S601, determine the degree of fragmentation of each text image corresponding to the target lyrics based on the volume amplitude.
[0129] The volume amplitude is directly proportional to the degree of fragmentation.
[0130] Specifically, the server or terminal used for data processing can pre-divide the volume amplitude at a preset frequency into multiple intervals and set a fragmentation level for each interval; the fragmentation level of each text image corresponding to the target lyrics can be determined by assigning the corresponding interval to the audio volume.
[0131] S602, segment the text image according to the degree of fragmentation, and use the dynamic splicing display process of the segmented text image as the entrance effect of the target lyrics.
[0132] In the embodiments of this application, such as Figure 4 As shown, the degree of fragmentation of each text image is determined by the volume amplitude of the audio, and the text images are spliced together into a complete text image based on the corresponding degree of fragmentation. This animation effect serves as the entrance effect for lyrics, allowing users to visually perceive the rhythm and melody changes of the audio, achieving a unity of auditory and visual senses and effectively improving the user experience.
[0133] This application provides a possible implementation method for determining the motion effect of the target lyrics on the display screen of the vehicle terminal based on the offset and / or offset direction, including:
[0134] S701, determine the movement distance of each text image corresponding to the target lyrics based on the offset.
[0135] The aforementioned offset is determined based on the vehicle's real-time speed.
[0136] In this embodiment, the offset, a dependent variable, can be pre-determined using linear regression to fit a function based on independent variables such as vehicle speed, acceleration, and time. The offset of the target lyrics can then be determined according to this linear function. For example, the fitting function can be as shown in formula (1):
[0137]
[0138] Where s is the offset of the target lyrics, a is the first coefficient, v is the real-time speed of the vehicle, t is time, and g is the real-time acceleration of the vehicle.
[0139] The aforementioned offset can also be determined based on the vehicle's acceleration.
[0140] In this embodiment of the application, the offset, a dependent variable, can be determined based on a fitting function of the vehicle's acceleration, an independent variable, and the offset of the target lyrics can be determined according to the fitting function; for example, the fitting function can be as shown in formula (2):
[0141] s = bg (2)
[0142] Where s is the offset of the target lyrics, b is the second coefficient, and g is the real-time acceleration of the vehicle.
[0143] In some implementations, the offset of the target lyrics can be normalized to obtain the movement distance of each text image. Furthermore, a threshold can be set for the movement distance; if the movement distance exceeds this threshold, the movement distance will remain unchanged.
[0144] In other implementations, the offset of the target lyrics can be directly used as the movement distance of each text image.
[0145] S702, determine the movement direction of each text image corresponding to the target lyrics based on the offset direction.
[0146] The aforementioned offset direction can be the direction of the vehicle's acceleration.
[0147] In this embodiment, when the vehicle's acceleration direction is forward, the corresponding offset direction can be downward of the vehicle terminal display screen; conversely, when the vehicle's acceleration direction is backward, the corresponding offset direction can be upward of the vehicle terminal display screen.
[0148] S703 determines the motion effect of the target lyrics based on the movement distance and direction of each text image.
[0149] In this embodiment of the application, the size of each text image in the target movement state of the target lyrics and the spacing between each text image can be determined based on the movement distance and movement direction of each text image, and the animation of each text image in the target lyrics gradually changing from the initial state to the above-mentioned target movement state can be used as the above-mentioned movement effect.
[0150] In some implementations, when the offset is determined based on the vehicle's real-time speed, a high vehicle speed and a large forward acceleration result in a large offset for the target lyrics. Consequently, the target lyrics move downwards. Generally, the faster the vehicle and the greater its acceleration, the greater the downward distance the target lyrics move towards the in-vehicle terminal display. From a special effects perspective, this means the target lyrics are compressed downwards by a significant distance. Conversely, if the vehicle's speed and acceleration are low, the target lyrics move a smaller distance on the in-vehicle terminal display. From a special effects perspective, this means the overall compression ratio of the target lyrics is very small.
[0151] In other implementations, when the offset is determined based on the vehicle's acceleration, a large forward acceleration corresponds to a large offset of the target lyrics, moving downwards. Generally, the greater the forward acceleration, the greater the downward movement of the target lyrics towards the vehicle's display screen. From a visual effect perspective, this means the target lyrics are compressed downwards by a significant distance. Conversely, a large leftward acceleration corresponds to a large offset of the target lyrics, moving to the right. Generally, the greater the leftward acceleration, the greater the rightward movement of the target lyrics towards the vehicle's display screen. From a visual effect perspective, this means the target lyrics are compressed to the right by a significant distance.
[0152] This application embodiment determines the motion effect of the target lyrics by the vehicle's driving state, so that the lyrics displayed on the in-vehicle terminal screen can change in real time with the vehicle's speed and acceleration, enhancing the passenger's immersive experience of viewing the screen and further improving the user experience.
[0153] This application provides a possible implementation method in which the above-mentioned determination of the appearance effect of each character in the target lyrics on the display screen of the vehicle terminal based on the encoded value includes:
[0154] For each character, the disappearance duration is determined based on the encoding value; the appearance effect is determined based on the disappearance duration.
[0155] The disappearance duration is used to indicate the duration of the disappearance animation after the text image corresponding to the text is segmented.
[0156] In this embodiment, the speed and duration of the text image being segmented into multiple fragments and disappearing can be determined based on the disappearance duration of each character, and then the entrance effect can be determined based on the above image segmentation and fragment disappearance animation. This application realizes the determination of dynamic and diverse lyric appearance methods according to the timestamp and syllable duration of each character in the target lyrics, which allows users to further experience the rhythm of the audio melody and enhances the entertainment value of the content displayed on the in-vehicle terminal.
[0157] To better understand the data processing methods described above, the following section will combine... Figure 5 A detailed example of a data processing method according to this application is provided, which includes the following steps:
[0158] S801, Server 502 obtains the sound intensity of the audio being played in the vehicle terminal 501.
[0159] The sound intensity can be a time-domain signal of sound, that is, a continuous signal in which the sound intensity changes over time. The aforementioned in-vehicle terminal is installed in vehicles equipped with a smart cockpit system, allowing users to interact with the cockpit system through the in-vehicle terminal to control the vehicle or engage in entertainment activities.
[0160] Specifically, the server can directly obtain the sound intensity of the audio from the preset storage space, or it can detect the real-time sound intensity of the audio based on the sound detection device.
[0161] S802 determines the pitch of audio based on sound intensity.
[0162] Among them, phonology is used to characterize the phonetic and rhythmic patterns of audio. The phonology of audio can be a frequency domain signal of sound.
[0163] Specifically, the server can convert sound intensity, i.e., the time-domain information of sound, into frequency-domain information and the pitch of audio based on Fourier transform.
[0164] S803, based on the rhythm, determines the entrance effect of the target lyrics corresponding to the audio on the display screen of the vehicle terminal 501.
[0165] The entrance effect can be an animation in which each character image corresponding to the target lyrics is gradually displayed on the screen.
[0166] Specifically, the server can determine the degree of fragmentation of each text image corresponding to the target lyrics based on the rhythm, and then determine the entrance effect based on the degree of fragmentation; the corresponding entrance effect can be an animation that aggregates the text images after being segmented according to the degree of fragmentation into a complete text image, and then gradually displays the target lyrics.
[0167] S804, server 502 obtains the vehicle's driving status in real time.
[0168] The driving status includes the vehicle's speed and direction of movement.
[0169] Specifically, the server can obtain the vehicle's driving status through the vehicle's central control system to obtain the vehicle's current speed and displacement direction.
[0170] S805, obtain the offset and offset direction of the target lyrics based on the movement speed and movement direction.
[0171] The target lyrics correspond to the audio being played on the vehicle's in-vehicle terminal. The vehicle's direction of movement can include the direction of acceleration, which includes forward and backward movement; the offset direction of the target lyrics includes left and right movement on the in-vehicle terminal's display screen.
[0172] Specifically, the server can pre-construct a fitting function for the vehicle's speed, acceleration, and the offset of the target lyrics. Then, based on the vehicle's real-time speed and acceleration, it calculates the offset of the target lyrics using the fitting function and determines the offset direction corresponding to the vehicle's movement direction. The fitting function can be used to characterize the linear relationship between the vehicle's real-time speed, acceleration, and the target offset.
[0173] In some implementations, when the vehicle's acceleration direction is forward, the corresponding offset direction can be to the right of the vehicle terminal display screen; conversely, when the vehicle's acceleration direction is backward, the corresponding offset direction can be to the left of the vehicle terminal display screen.
[0174] S806, determine the motion effect of the target lyrics on the display screen of the vehicle terminal 501 based on at least one of offset and offset direction.
[0175] The aforementioned motion effects can be animations in which the size and spacing of the text images corresponding to the target lyrics change as the vehicle moves.
[0176] Specifically, the server can determine the moving distance and direction of each text image corresponding to the target lyrics based on the offset and offset direction, and change the size and spacing of each text image according to the above moving distance and moving direction, thereby generating a moving effect.
[0177] S807, obtain the time statistics information of each character in the target lyrics; encode each character based on the time statistics information of each character to obtain the encoded value of each character in the target lyrics.
[0178] The time statistics include the timestamp of the text and the syllable duration. The syllable duration can be the length of the syllables represented by the text. The encoded value can be an MD5 value.
[0179] S808 determines the appearance effect of each character in the target lyrics on the display screen of the vehicle terminal 501 based on the encoding value.
[0180] Specifically, the server can determine the disappearance animation of the corresponding text image based on the appearance speed and appearance direction corresponding to the encoded value, and use the disappearance animation as the appearance effect of the target lyrics on the display screen.
[0181] This application embodiment detects the vehicle's driving status, obtains the vehicle's speed and direction of movement, and determines the target lyrics of the audio being played on the vehicle's in-vehicle terminal. Then, based on the speed and direction of movement, it obtains the offset and direction of the target lyrics, and further determines the motion effect of the target lyrics on the in-vehicle terminal's display screen based on at least one of the offset and direction of movement. This application embodiment determines the motion effect of the target lyrics on the display screen based on the vehicle's driving status, achieving a motion effect where the target lyrics change synchronously with the vehicle's speed and direction of movement, enhancing the fun and diversity of the lyrics display, and effectively improving the driving experience.
[0182] This application provides a data processing apparatus, such as... Figure 6 As shown, the data processing device 60 may include: a first acquisition module 601, a second acquisition module 602, and a determination module 603;
[0183] The first acquisition module 601 is used to acquire the driving status of the vehicle; wherein the driving status includes at least one of the vehicle's speed and direction of movement.
[0184] The second acquisition module 602 is used to acquire at least one of the offset amount and offset direction of the target lyrics based on at least one of the moving speed and the moving direction; wherein the target lyrics correspond to the audio being played in the vehicle's in-vehicle terminal;
[0185] The determination module 603 is used to determine the motion effects of the target lyrics on the display screen of the vehicle terminal based on the offset and / or offset direction.
[0186] This application embodiment provides a possible implementation, and the above-described apparatus further includes an entrance effects module, used for:
[0187] Get the sound intensity of the audio;
[0188] The rhythm of an audio is determined based on sound intensity; where rhythm is used to characterize the phonetic and prosodic rules of an audio.
[0189] The entrance effects on the in-vehicle terminal's display screen are determined based on the rhythm of the audio to correspond to the target lyrics.
[0190] This application embodiment provides a possible implementation, and the above-described apparatus further includes an entrance effects module, used for:
[0191] Obtain the time statistics information for each character of the target lyrics; the time statistics information includes the timestamp of the character and the duration of the syllable;
[0192] Encode each character based on the time statistics of each character to obtain the encoded value of each character in the target lyrics;
[0193] The appearance effect of each character in the target lyrics on the vehicle terminal's display screen is determined based on the encoded value.
[0194] This application provides a possible implementation method in which the above-mentioned entrance effect module, when determining the pitch of the audio based on sound intensity, is used for:
[0195] The time-domain signal of sound intensity is converted into a frequency-domain signal; the frequency-domain signal is used to characterize the volume amplitude of audio at different frequencies.
[0196] The volume amplitude is used as the pitch of the audio.
[0197] This application provides a possible implementation method in which the above-mentioned entrance effect module, when determining the entrance effect of the target lyrics corresponding to the audio on the display screen of the vehicle terminal based on the rhythm, is used to:
[0198] The degree of fragmentation of each text image corresponding to the target lyrics is determined based on the volume amplitude; where the volume amplitude is directly proportional to the degree of fragmentation.
[0199] The text image is segmented according to its degree of fragmentation, and the process of dynamically splicing the segmented text images is used as the entrance effect for the target lyrics.
[0200] This application embodiment provides a possible implementation method in which the determining module 603, when determining the motion effect of the target lyrics on the display screen of the vehicle terminal based on the offset and / or offset direction, is used to:
[0201] The movement distance of each text image corresponding to the target lyrics is determined based on the offset.
[0202] The direction of movement for each text image corresponding to the target lyrics is determined based on the offset direction;
[0203] Based on the movement distance and direction of each text image, the movement effect of the target lyrics is determined.
[0204] This application embodiment provides a possible implementation method. When the above-mentioned entrance effect module encodes each character based on the time statistics information of each character to obtain the encoded value of each character in the target lyrics, it is used for:
[0205] For each character, the timestamp and syllable duration corresponding to the character are concatenated to generate the target string of the character; the target string is used as the key, and the encoded value of the key is generated based on the preset mapping relationship.
[0206] This application provides a possible implementation method in which the above-mentioned entrance effect module, when determining the entrance effect of each character in the target lyrics on the display screen of the vehicle terminal based on the encoding value, is used to:
[0207] For each character, the disappearance duration is determined based on the encoding value; whereby the disappearance duration is used to indicate the duration of the disappearance animation after the character image is segmented.
[0208] The appearance effect is determined based on the duration of the disappearance.
[0209] The apparatus in this application embodiment can execute the method provided in this application embodiment, and the implementation principle is similar. The actions performed by each module in the apparatus of each embodiment of this application correspond to the steps in the method of each embodiment of this application. For detailed functional descriptions of each module of the apparatus, please refer to the descriptions in the corresponding methods shown above, which will not be repeated here.
[0210] This application embodiment detects the vehicle's driving status, obtains the vehicle's speed and direction of movement, and determines the target lyrics of the audio being played on the vehicle's in-vehicle terminal. Then, based on the speed and direction of movement, it obtains the offset and direction of the target lyrics, and further determines the motion effect of the target lyrics on the in-vehicle terminal's display screen based on at least one of the offset and direction of movement. This application embodiment determines the motion effect of the target lyrics on the display screen based on the vehicle's driving status, achieving a motion effect where the target lyrics change synchronously with the vehicle's speed and direction of movement, enhancing the fun and diversity of the lyrics display, and effectively improving the driving experience.
[0211] This application provides an electronic device, including a memory, a processor, and a computer program stored in the memory. The processor executes the computer program to implement the steps of a data processing method. Compared with related technologies, this application can achieve the following: This application detects the driving state of a vehicle, obtains the vehicle's speed and direction of movement, and determines the target lyrics of the audio being played on the vehicle's in-vehicle terminal. Then, based on the speed and direction of movement, it obtains the offset and offset direction of the target lyrics, and further determines the motion effect of the target lyrics on the display screen of the in-vehicle terminal based on at least one of the offset and offset direction. This application determines the motion effect of the target lyrics on the display screen based on the vehicle's driving state, realizing a motion effect where the target lyrics change synchronously with the vehicle's speed and direction of movement, enhancing the fun and diversity of the lyrics display, and effectively improving the driving experience.
[0212] In one alternative embodiment, an electronic device is provided, such as Figure 7 As shown, Figure 7The illustrated electronic device 700 includes a processor 701 and a memory 703. The processor 701 and the memory 703 are connected, for example, via a bus 702. Optionally, the electronic device 700 may further include a transceiver 704, which can be used for data interaction between the electronic device and other electronic devices, such as sending and / or receiving data. It should be noted that in practical applications, the transceiver 704 is not limited to one type, and the structure of this electronic device 700 does not constitute a limitation on the embodiments of this application.
[0213] Processor 701 may be a CPU (Central Processing Unit), a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. Processor 701 may also be a combination that implements computational functions, such as including one or more microprocessor combinations, a combination of a DSP and a microprocessor, etc.
[0214] Bus 702 may include a pathway for transmitting information between the aforementioned components. Bus 702 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus, etc. Bus 702 can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 7 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.
[0215] The memory 703 may be ROM (Read Only Memory) or other types of static storage devices capable of storing static information and instructions, RAM (Random Access Memory) or other types of dynamic storage devices capable of storing information and instructions, or EEPROM (Electrically Erasable Programmable Read Only Memory), CD-ROM (Compact Disc Read Only Memory) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital universal optical discs, Blu-ray discs, etc.), magnetic disk storage media, other magnetic storage devices, or any other medium capable of carrying or storing computer programs and capable of being read by a computer, without limitation herein.
[0216] The memory 703 stores computer programs that execute embodiments of this application, and the processor 701 controls their execution. The processor 701 executes the computer programs stored in the memory 703 to implement the steps shown in the foregoing method embodiments.
[0217] Electronic devices include, but are not limited to: mobile terminals such as mobile phones, laptops, and tablets, as well as fixed terminals such as digital TVs and desktop computers.
[0218] This application provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, it can implement the steps and corresponding content of the aforementioned method embodiments.
[0219] This application provides a computer program product or computer program that includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the following actions:
[0220] Obtain the vehicle's driving status; wherein the driving status includes at least one of the vehicle's speed and direction of movement;
[0221] The offset of the target lyrics is obtained based on at least one of the movement speed and movement direction; wherein the target lyrics correspond to the audio being played in the vehicle's in-vehicle terminal.
[0222] The motion effects of the target lyrics on the display screen of the vehicle terminal are determined based on the offset and / or offset direction.
[0223] The terms "first," "second," "third," "fourth," "1," "2," etc. (if present) in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in a sequence other than that shown in the figures or text.
[0224] It should be understood that although arrows indicate various operation steps in the flowcharts of this application's embodiments, the order in which these steps are implemented is not limited to the order indicated by the arrows. Unless explicitly stated herein, in some implementation scenarios of this application's embodiments, the implementation steps in each flowchart can be executed in other orders as required. Furthermore, some or all steps in each flowchart, based on the actual implementation scenario, may include multiple sub-steps or multiple stages. Some or all of these sub-steps or stages can be executed at the same time, and each sub-step or stage can also be executed at different times. In scenarios where execution times differ, the execution order of these sub-steps or stages can be flexibly configured according to requirements, and this application's embodiments do not limit this.
[0225] The above description is only an optional implementation method for some implementation scenarios of this application. It should be noted that for those skilled in the art, other similar implementation methods based on the technical concept of this application without departing from the technical concept of this application also fall within the protection scope of the embodiments of this application.
Claims
1. A data processing method, characterized in that, include: The driving status of the vehicle is obtained; wherein the driving status includes at least one of the vehicle's speed and direction of movement. The offset of the target lyrics is obtained based on at least one of the moving speed and the moving direction; wherein the target lyrics correspond to the audio being played in the vehicle's in-vehicle terminal. The motion effect of the target lyrics on the display screen of the vehicle terminal is determined based on the offset amount and / or offset direction; The step of determining the motion effect of the target lyrics on the display screen of the vehicle terminal based on the offset and / or offset direction includes: determining the motion distance of each text image corresponding to the target lyrics based on the offset; determining the motion direction of each text image corresponding to the target lyrics based on the offset direction; and determining the motion effect of the target lyrics based on the motion distance and motion direction of each text image.
2. The method according to claim 1, characterized in that, The method further includes: Obtain the sound intensity of the audio; The pitch of the audio is determined based on the sound intensity; wherein the pitch is used to characterize the phonological rules of the audio. The entrance effect on the display screen of the vehicle terminal is determined based on the musical rhythm and the target lyrics corresponding to the audio.
3. The method according to claim 1, characterized in that, The method further includes: Obtain the time statistics information for each character of the target lyrics; wherein, the time statistics information includes the timestamp and syllable duration of the character; Encode each character based on the time statistics of each character to obtain the encoded value of each character in the target lyrics; The appearance effect of each character in the target lyrics on the display screen of the vehicle terminal is determined based on the encoded value.
4. The method according to claim 2, characterized in that, Determining the pitch of the audio based on the sound intensity includes: The time-domain signal of the sound intensity is converted into a frequency-domain signal; wherein the frequency-domain signal is used to characterize the volume amplitude of the audio at different frequencies; The volume amplitude is used as the pitch of the audio.
5. The method according to claim 4, characterized in that, The entrance effect on the display screen of the vehicle terminal, which determines the target lyrics corresponding to the audio based on the melody, includes: The degree of fragmentation of each text image corresponding to the target lyrics is determined based on the volume amplitude; wherein, the volume amplitude is proportional to the degree of fragmentation. The text image is segmented according to the degree of fragmentation, and the process of dynamically splicing the segmented text image is used as the entrance effect of the target lyrics.
6. The method according to claim 3, characterized in that, The process of encoding each character based on the time statistics information of each character to obtain the encoded value of each character in the target lyrics includes: For each character, the timestamp and syllable duration corresponding to the character are concatenated to generate the target string of the character; the target string is used as a key, and the encoded value of the key is generated based on a preset mapping relationship.
7. The method according to claim 3, characterized in that, The step of determining the appearance effect of each character in the target lyrics on the display screen of the vehicle terminal based on the encoded value includes: For each character, the disappearance duration corresponding to the character is determined based on the encoding value; wherein, the disappearance duration is used to indicate the duration of the disappearance animation after the character image is segmented; The appearance effect is determined based on the duration of disappearance.
8. A data processing apparatus, characterized in that, include: The first acquisition module is used to acquire the driving status of the vehicle; wherein the driving status includes at least one of the vehicle's speed and direction of movement; The second acquisition module is used to acquire at least one of the offset amount and offset direction of the target lyrics based on at least one of the moving speed and moving direction; wherein the target lyrics correspond to the audio being played in the vehicle's in-vehicle terminal; A determining module is used to determine the motion effect of the target lyrics on the display screen of the vehicle terminal based on the offset and / or offset direction; The determining module is used to determine the moving distance of each text image corresponding to the target lyrics based on the offset; determine the moving direction of each text image corresponding to the target lyrics based on the offset direction; and determine the moving effect of the target lyrics based on the moving distance and moving direction of each text image.
9. An electronic device comprising a memory, a processor, and a computer program stored in the memory, characterized in that, The processor executes the computer program to implement the steps of the method according to any one of claims 1 to 7.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 7.
Citation Information
Patent Citations
Method and a device for dynamic display of lyrics
CN109257499A
Vehicle-mounted dynamic content delivery systems
US20210233115A1