Information processing method, information processing device, storage medium, and electronic device

Abstract

The present disclosure provides an information processing method, device, storage medium and electronic equipment, and relates to the technical field of computers. The information processing method comprises: obtaining to-be-processed information for display in a display interface, the to-be-processed information comprising at least one piece of text information and at least one piece of audio information; determining an audio picture corresponding to the audio information, and segmenting the audio picture to obtain an audio sub-picture; and based on a single-line capacity parameter of the display interface, arranging the audio sub-picture and the text information in lines in the display interface to obtain a line arrangement result of the to-be-processed information. The present disclosure segments the audio picture, thereby realizing adaptive line arrangement of the audio picture and the text information, which not only can be applied to display of a larger size audio picture, but also can save interface space to a certain extent.

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and in particular to an information processing method, an information processing apparatus, a computer-readable storage medium, and an electronic device. Background Technology

[0002] To meet users' diverse information needs, different types of information, such as text and images, are usually displayed on the interface for users to browse.

[0003] In related technologies, when text and image information are mixed and arranged in a display interface, for image information, the entire image is usually inserted directly into the display interface for user viewing, such as... Figure 1 As shown. This arrangement may waste interface space, and due to the limited display size of the interface, the size of the inserted images cannot be too large, otherwise the images will not display correctly, and it is not suitable for images with large sizes.

[0004] It should be noted that the information disclosed in the background section above is only used to enhance the understanding of the background of this disclosure, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention

[0005] This disclosure provides an information processing method, an information processing apparatus, a computer-readable storage medium, and an electronic device, thereby overcoming, at least to some extent, the problems of wasted interface space and inapplicability to larger images in the related art.

[0006] Other features and advantages of this disclosure will become apparent from the following detailed description, or may be learned in part from practice of this disclosure.

[0007] According to a first aspect of this disclosure, an information processing method is provided, the method comprising: acquiring information to be processed for display in a display interface, the information to be processed including at least one piece of text information and at least one piece of audio information; determining an audio image corresponding to the audio information and segmenting the audio image to obtain audio sub-images; and arranging the audio sub-images and the text information in separate lines in the display interface based on a single-line capacity parameter of the display interface to obtain a line arrangement result of the information to be processed.

[0008] According to a second aspect of this disclosure, an information processing apparatus is provided, the apparatus comprising: an information acquisition module, configured to acquire information to be processed for display in a display interface, the information to be processed including at least one piece of text information and at least one piece of audio information; an image segmentation module, configured to determine an audio image corresponding to the audio information and segment the audio image to obtain audio sub-images; and an information arrangement module, configured to arrange the audio sub-images and the text information in separate lines in the display interface based on a single-line capacity parameter of the display interface, so as to obtain a line arrangement result of the information to be processed.

[0009] According to a third aspect of this disclosure, a computer-readable storage medium is provided, on which a computer program is stored, wherein the computer program, when executed by a processor, implements any of the above-described information processing methods.

[0010] According to a fourth aspect of this disclosure, an electronic device is provided, comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to perform any of the above-described information processing methods by executing the executable instructions.

[0011] The technical solution disclosed herein has the following beneficial effects:

[0012] In the aforementioned information processing, information to be processed for display on the interface is obtained, including at least one piece of text information and at least one piece of audio information; the audio image corresponding to the audio information is determined, and the audio image is segmented to obtain audio sub-images; based on the single-line capacity parameter of the display interface, the audio sub-images and text information are arranged in separate lines on the display interface to obtain the line arrangement result of the information to be processed. This disclosure segments the audio image corresponding to the audio information to achieve adaptive line arrangement of audio images and text information, which is not only suitable for displaying larger-sized audio images, but also saves interface space to a certain extent.

[0013] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0014] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure. It is obvious that the drawings described below are merely some embodiments of this disclosure, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort.

[0015] Figure 1 This image illustrates a scenario of mixed text and graphics in related technologies.

[0016] Figure 2 This diagram illustrates a flowchart of an information processing method according to this exemplary embodiment;

[0017] Figure 3 An example diagram of an audio input interface in this exemplary embodiment is shown;

[0018] Figure 4 This illustration shows an example of an audio-image comparison in this exemplary embodiment;

[0019] Figure 5 This illustration shows an example of segmenting an audio image along the width of the image in this exemplary embodiment.

[0020] Figure 6 This diagram illustrates a structural diagram of a TextKit framework in this exemplary embodiment;

[0021] Figure 7 This exemplary embodiment illustrates an information processing flowchart that horizontally displays information to be processed.

[0022] Figure 8 This diagram illustrates an example of an interface for horizontally displaying information to be processed in this exemplary embodiment.

[0023] Figure 9 This exemplary embodiment illustrates an information processing flowchart that vertically displays information to be processed.

[0024] Figure 10 This illustration shows an example diagram of a vertically displayed information to be processed in this exemplary embodiment;

[0025] Figure 11 This diagram illustrates a structural block diagram of an information processing apparatus according to this exemplary embodiment;

[0026] Figure 12 An electronic device for implementing the above-described information processing method is shown in this exemplary embodiment. Detailed Implementation

[0027] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided to make this disclosure more comprehensive and complete, and to fully convey the concept of the example embodiments to those skilled in the art. The described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a full understanding of embodiments of this disclosure. However, those skilled in the art will recognize that the technical solutions of this disclosure can be practiced with one or more of the specific details omitted, or other methods, components, apparatus, steps, etc., can be employed. In other instances, well-known technical solutions are not shown or described in detail to avoid obscuring various aspects of this disclosure.

[0028] Furthermore, the accompanying drawings are merely illustrative of this disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and therefore repeated descriptions of them will be omitted. Some block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities may be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0029] In this article, "first," "second," etc., are labels for specific objects, rather than limiting the number or order of objects.

[0030] In related technologies, the entire image is usually inserted directly into the display interface and mixed with text information, which may waste interface space. Moreover, due to the limited display size of the display interface, it is impossible to display images with large sizes (e.g., audio images whose width exceeds the maximum width capacity of the display interface) normally.

[0031] In view of one or more of the above-mentioned problems, exemplary embodiments of this disclosure provide an information processing method, an information processing apparatus, a computer-readable storage medium, and an electronic device. These can be applied to scenarios involving the mixing of audio, images, and text information.

[0032] like Figure 2 The diagram illustrates a flowchart of an information processing method, which may include the following steps S210 to S230:

[0033] Step S210: Obtain the information to be processed for display in the display interface. The information to be processed includes at least one piece of text information and at least one piece of audio information.

[0034] Step S220: Determine the audio image corresponding to the audio information, and segment the audio image to obtain audio sub-images;

[0035] Step S230: Based on the single-line capacity parameter of the display interface, the audio sub-images and text information are arranged in separate lines on the display interface to obtain the line arrangement result of the information to be processed.

[0036] In the above information processing process, by segmenting the audio image corresponding to the audio information, the audio image and text information are arranged in an adaptive line layout. This not only applies to the display of larger audio images, but also saves interface space to a certain extent.

[0037] It should be noted that the display interface in this disclosure can display the information to be processed both horizontally and vertically. Horizontal display means that the horizontally arranged information to be processed is considered as one row; vertical display means that the vertically arranged information to be processed is considered as one row.

[0038] The following example uses a horizontal display of information to be processed. Figure 2 Each step is explained in detail.

[0039] In step S210, information to be processed is obtained for display on the display interface. The information to be processed includes at least one piece of text information and at least one piece of audio information.

[0040] The display interface refers to the interface that can be used to display different types of information, such as the display interface on smart terminal devices with display screens, such as mobile phones, computers, smart bracelets, and smartwatches.

[0041] The information to be processed refers to the information that needs to be displayed on the interface, including at least one piece of text information and at least one piece of audio information. The text information can include various types of text information such as text, symbols, and numbers; the audio information can be in audio formats such as mp3 (MPEG Audio Layer 3, a dynamic audio compression format), wav (Waveform Audio File Format, a file format for storing waveform sound), and aac (Advanced Audio Coding).

[0042] It should be noted that the text and audio formats listed here are merely illustrative examples. In actual use, other formats may also be used, and no specific limitations are made here.

[0043] By acquiring the pending information to be displayed on the display interface, the display interface is provided with the basis for the content to be displayed. Specifically, the pending information can be acquired in the following ways to meet the user's display needs for different pending information.

[0044] Optionally, the pending information to be displayed in the display interface can be obtained through the following steps: based on the user's text input operation in the text input interface, the text information entered by the user is taken as pending information; based on the user's audio recording operation in the audio input interface, the audio information recorded by the user is taken as pending information.

[0045] For example, such as Figure 3 The diagram illustrates an example of an audio input interface. It can respond to user clicks on the audio recording control 310 in the audio input interface 300 to record audio. During recording, the audio recording control 310 can transition from an initial recording state 311 to an intermediate recording state 312, displaying the current recording duration. After recording stops, the audio recording control 310 can transition from the intermediate recording state 312 to the end recording state 313, displaying the audio duration, a delete control 320, and a save control 330. The delete control 320 can be used to delete the recorded audio information, and the save control 330 can be used to save the recorded audio information. After recording stops, in response to user clicks on the audio recording control 310, the control can transition from the end recording state 313 to the audio playback state 314, displaying the current playback duration to play back the recorded audio information, allowing the user to determine whether the recorded audio information needs to be retained.

[0046] Optionally, the following steps can be used to obtain the information to be processed for display in the display interface: responding to text addition operations performed on existing text information, and using the added text information as the information to be processed; responding to audio addition operations performed on existing audio information, and using the added audio information as the information to be processed.

[0047] Optionally, the pending information to be displayed in the display interface can be obtained through the following steps: receiving pending information sent by other devices in a certain order.

[0048] It should be noted that the text information contained in the information to be processed can be obtained by user input, by adding existing text information, or by obtaining it from other devices; the audio information contained in the information to be processed can be obtained by user recording, by adding existing audio information, or by obtaining it from other devices. In practical applications, the appropriate method for obtaining the information to be processed can be adopted according to actual needs, and no specific limitations are made here.

[0049] In step S220, the audio image corresponding to the audio information is determined, and the audio image is segmented to obtain audio sub-images.

[0050] In this context, an audio image refers to an audio picture that matches the attribute characteristics of the audio information. Specifically, the size of the audio image can be determined based on the attribute characteristics of the audio information, and the corresponding audio image can be obtained based on the audio image size. The attribute characteristics of the audio information can include, for example, audio duration and memory space occupied by the audio; the size of the audio image can include, for example, the height and width of the audio image.

[0051] In one optional implementation, determining the audio image corresponding to the audio information in step S220 can be achieved through the following steps: determining the width of the audio image based on the audio duration corresponding to the audio information, wherein the width of the audio image is positively correlated with the audio duration; and determining the audio image that matches the audio information based on the pre-configured audio image height and audio image width.

[0052] The width of the audio image is positively correlated with the audio duration; the longer the audio duration, the wider the audio image; and the shorter the audio duration, the shorter the audio image. This can more intuitively reflect the audio duration, thereby improving the user's visual perception of the audio duration.

[0053] For example, such as Figure 4 As shown, an example image comparing audio and images is provided, wherein the width of the audio image corresponding to audio information with a duration of 12 seconds is greater than the width of the audio image corresponding to audio information with a duration of 6 seconds.

[0054] The pre-configured audio image height can be a pre-defined image height parameter. Specifically, based on the pre-configured audio image height and width, the size of the audio image matching the audio information can be determined, and then the corresponding audio image can be generated.

[0055] In one optional implementation, the above-mentioned determination of the audio image matching the audio information based on the pre-configured audio image height and audio image width can be achieved through the following steps: adjusting the pre-configured audio image height according to the font size corresponding to the text information; and determining the audio image matching the audio information based on the adjusted pre-configured audio image height and audio image width.

[0056] For example, if the font height of the text information is greater than the height of the pre-configured audio image, the height of the pre-configured audio image will be increased; if the font height of the text information is less than the height of the pre-configured audio image, the height of the pre-configured audio image will be decreased, so that the height of the audio image can adapt to the font size of the text information, thereby optimizing the display effect.

[0057] Optionally, determining the audio image corresponding to the audio information in step S220 can also be achieved through the following steps: determining the width of the audio image based on the memory space occupied by the audio information, where the width of the audio image is positively correlated with the memory space occupied by the audio; and determining the audio image that matches the audio information based on the pre-configured audio image height and width. The positive correlation between the audio image width and the memory space occupied by the audio image can more intuitively reflect the audio memory space usage, thereby improving the user's visual perception of audio memory space usage.

[0058] After determining the audio image corresponding to the audio information, the audio image can be segmented to obtain audio sub-images.

[0059] In one optional implementation, step S220 involves segmenting the audio image to obtain audio sub-images. This can be achieved through the following steps: segmenting the audio image along the width direction to obtain audio sub-images, such that the height of the audio sub-image is equal to the height of the audio image, and the width of the audio sub-image is less than the width of the audio image.

[0060] Here, an audio sub-image refers to an image obtained by segmenting an audio image. For example, such as... Figure 5 As shown, an audio image can be segmented along its width to obtain multiple sub-images.

[0061] In the above steps, by segmenting the wider audio image, the audio image can wrap to the next line, thus avoiding the problem of the display interface not being able to display properly due to the audio image being too wide, and it can also save interface space to a certain extent.

[0062] In one optional implementation, the above-mentioned segmentation of the audio image to obtain audio sub-images can be achieved through the following steps: the audio image can be segmented according to a pre-configured image segmentation length.

[0063] In one optional implementation, the above-mentioned segmentation of the audio image to obtain audio sub-images can also be achieved through the following steps: determining the image segmentation length based on the font size corresponding to the text information; and segmenting the audio image based on the image segmentation length to obtain audio sub-images.

[0064] The image segmentation length refers to the interval parameter between the segmentation points of the audio image. Segmenting the audio image based on the image segmentation length is simple and easy to implement. For example, the width of the font can be used as the image segmentation length so that the width of each audio sub-image is consistent with the width of each font, which facilitates line break detection.

[0065] In step S230, based on the single-line capacity parameter of the display interface, the audio sub-images and text information are arranged in separate lines on the display interface to obtain the line arrangement result of the information to be processed.

[0066] The single-line capacity parameter refers to the maximum size that a single line of the display interface can accommodate. Audio sub-images and text information can be arranged in lines. When the audio sub-images and text information arranged in a line reach the single-line capacity parameter of the display interface, line wrapping is performed to adapt to different display interface sizes and meet the arrangement requirements of different audio durations.

[0067] In one optional implementation, in step S230, based on the single-line capacity parameter of the display interface, the audio sub-images and text information are arranged in separate lines on the display interface to obtain the line arrangement result of the information to be processed. Specifically, this can be achieved through the following steps: based on the order in which the text information and audio information in the information to be processed are added, the arrangement order of the audio sub-images corresponding to the audio images and the text information is determined; based on the single-line capacity parameter of the display interface, the text information and the audio sub-images corresponding to the audio images are arranged in separate lines according to the arrangement order to obtain the line arrangement result of the information to be processed.

[0068] In the above steps, the information is arranged in rows according to the order in which it is added, which enables the orderly arrangement of the information to be processed. This allows users to edit and arrange the information according to their own wishes, improving the flexibility and controllability of information processing.

[0069] Optional, Figure 2 The steps shown can be based on Figure 6 The TextKit framework, as shown, is used for implementation. It's important to note that the TextKit framework is a wrapper around Core Text, enabling most of Core Text's functionality with concise calls, thus providing powerful text layout and rendering capabilities. The main member objects in the TextKit framework include the text container object (NSTextContainer), the text storage object (NSTextStorage), and the layout manager object (NSLayoutManager). The text storage object is responsible for storing the text to be processed and its properties; the layout manager object is responsible for character encoding and layout; and the text container object defines the area where the text is displayed. Furthermore, Figure 6 In this context, a UILabel is a control used to display non-editable text, a UITextField is a control used to accept user input, and a UITextView is a control used to display editable text.

[0070] In one alternative implementation, the audio sub-images and text information are arranged in separate lines in the display interface. This can be achieved through the following steps: if multiple audio sub-images belonging to the same audio image are located in the same line in the display interface, then there is no gap between any two adjacent audio sub-images.

[0071] In the above steps, adjacent audio sub-images that are located in the same row and belong to the same audio image are stitched together to ensure the integrity of the audio image as much as possible and to avoid the audio image being too fragmented, making it difficult for users to distinguish audio information objects.

[0072] For example, such as Figure 7 As shown, an information processing flowchart is provided that displays information to be processed horizontally. The horizontally arranged information to be processed is regarded as a row, and specifically includes the following steps:

[0073] Step S701: Obtain the information to be processed for display in the display interface. The information to be processed includes at least one piece of text information and at least one piece of audio information.

[0074] Step S702: Determine the width of the audio image based on the audio duration corresponding to the audio information. The width of the audio image is positively correlated with the audio duration.

[0075] Step S703: Determine the height of the audio image based on the font size corresponding to the text information;

[0076] Step S704: Based on the audio image height and audio image width, determine the audio image that matches the audio information;

[0077] Step S705: Determine the image segmentation length based on the font size corresponding to the text information;

[0078] Step S706: Based on the image segmentation length, the audio image is segmented along the image width direction to obtain audio sub-images;

[0079] Step S707: Based on the single-line capacity parameter of the display interface, the audio sub-images and text information are arranged in separate lines on the display interface to obtain the line arrangement result of the information to be processed.

[0080] like Figure 8 As shown in the figure, an example interface diagram is provided to display information to be processed horizontally, treating the horizontally arranged information to be processed as a row.

[0081] For example, such as Figure 9 As shown, an information processing flowchart is provided that vertically displays information to be processed. The vertically arranged information to be processed is regarded as a row, and specifically includes the following steps:

[0082] Step S901: Obtain the information to be processed for display in the display interface. The information to be processed includes at least one piece of text information and at least one piece of audio information.

[0083] Step S902: Determine the height of the audio image based on the audio duration corresponding to the audio information. The height of the audio image is positively correlated with the audio duration.

[0084] Step S903: Determine the width of the audio image based on the font size corresponding to the text information;

[0085] Step S904: Based on the audio image height and audio image width, determine the audio image that matches the audio information;

[0086] Step S905: Determine the image segmentation length based on the font size corresponding to the text information;

[0087] Step S906: Based on the image segmentation length, the audio image is segmented along the image height direction to obtain audio sub-images;

[0088] Step S907: Based on the single-line capacity parameter of the display interface, the audio sub-images and text information are arranged in separate lines on the display interface to obtain the line arrangement result of the information to be processed.

[0089] like Figure 10 As shown, an example diagram is provided to display information to be processed vertically, treating the vertically arranged information to be processed as a single row.

[0090] Optionally, when arranging audio sub-images and text information in separate lines on the display interface, one audio sub-image can be selected from those belonging to the same audio image to display the audio playback indicator, such as... Figure 8 The audio playback identifier 801 indicates to the user that the image is an audio image and can be played; it also allows selecting an audio sub-image from among the audio sub-images belonging to the same audio image to display the audio duration of the audio information corresponding to that audio image, such as... Figure 8 The audio duration 802 is shown in the image to indicate the audio duration corresponding to the relevant audio information to the user.

[0091] In one alternative implementation, after arranging the audio sub-images and text information in separate lines on the display interface, the following steps may also be performed: in response to a playback start operation applied to the coverage area of ​​any audio sub-image, the audio information corresponding to the audio image to which any audio sub-image belongs is played.

[0092] For example, the playback start operation can be a click operation, a long press operation, or the operation of clicking on any area covered by an audio sub-image.

[0093] In the above steps, using the coverage area of ​​the audio sub-image as the trigger area for audio playback is beneficial to improving the convenience of user operation.

[0094] In one alternative implementation, the audio sub-image can be a dynamic image, where a dynamic image refers to an image capable of producing dynamic effects. When the audio is played, the audio sub-image can display corresponding dynamic effects, such as a water ripple effect.

[0095] Optionally, when the audio information is played, corresponding dynamic effects can be displayed in each audio sub-image of the target audio image to prompt the user about the currently playing audio information object. The target audio image is the audio image corresponding to the currently playing audio information.

[0096] Optionally, when the audio information is played, the current playback progress of the audio information can be obtained; the audio sub-image that matches the current playback progress can be determined from the audio sub-images contained in the audio image corresponding to the audio information; and the audio sub-image that matches the current playback progress can be dynamically displayed to prompt the user about the audio information object that is currently being played and the playback progress.

[0097] Optionally, while playing audio, a countdown can be added to the audio sub-image containing the audio duration corresponding to the target audio information to display the audio playback progress. The target audio information is the currently playing audio information.

[0098] Figure 11 An information processing apparatus 1100 according to an exemplary embodiment of this disclosure is shown. For example... Figure 11 As shown, the information processing device 1100 may include:

[0099] The information acquisition module 1110 is used to acquire information to be processed for display in the display interface, the information to be processed including at least one piece of text information and at least one piece of audio information;

[0100] Image segmentation module 1120 is used to determine the audio image corresponding to the audio information and segment the audio image to obtain audio sub-images;

[0101] The information arrangement module 1130 is used to arrange the audio sub-image and the text information in separate lines on the display interface based on the single-line capacity parameter of the display interface, so as to obtain the line arrangement result of the information to be processed.

[0102] In an optional implementation, based on the aforementioned scheme, the image segmentation module 1120 may include: a width determination module, used to determine the width of the audio image based on the audio duration corresponding to the audio information, wherein the width of the audio image is positively correlated with the audio duration; and an audio image determination module, used to determine an audio image that matches the audio information based on a pre-configured audio image height and audio image width.

[0103] In an optional implementation, based on the aforementioned scheme, the audio image determination module can be configured to: adjust the height of a pre-configured audio image according to the font size corresponding to the text information; and determine an audio image that matches the audio information based on the adjusted pre-configured audio image height and the audio image width.

[0104] In an optional implementation, based on the aforementioned scheme, the image segmentation module 1120 segments the audio image to obtain audio sub-images. This can be configured to: segment the audio image along the width direction of the image to obtain audio sub-images, such that the height of the audio sub-image is equal to the height of the audio image, and the width of the audio sub-image is less than the width of the audio image.

[0105] In an optional implementation, based on the aforementioned scheme, the image segmentation module 1120 segments the audio image to obtain audio sub-images. It can also be configured to: determine the image segmentation length based on the font size corresponding to the text information; and segment the audio image based on the image segmentation length to obtain audio sub-images.

[0106] In an optional implementation, based on the aforementioned scheme, the information arrangement module 1130 can be configured to: determine the arrangement order of the audio sub-images corresponding to the audio images and the text information based on the order in which the text information and audio information in the information to be processed are added; and arrange the text information and the audio sub-images corresponding to the audio images in rows according to the arrangement order based on the single-row capacity parameter of the display interface, so as to obtain the row arrangement result of the information to be processed.

[0107] In an optional implementation, based on the aforementioned scheme, after arranging the audio sub-images and text information in separate lines on the display interface, the information processing device 1100 may further include: an audio playback module, used to respond to a playback start operation applied to the coverage area of ​​any audio sub-image, and to play the audio information corresponding to the audio image to which any audio sub-image belongs.

[0108] In an optional implementation, based on the aforementioned scheme, the audio sub-images in the information processing device 1100 are dynamic images. The information processing device 1100 further includes: a playback progress acquisition module, used to acquire the current playback progress of the audio information when the audio information is played; a sub-image matching module, used to determine the audio sub-image that matches the current playback progress from the audio sub-images contained in the audio image corresponding to the audio information; and a sub-image dynamic display module, used to dynamically display the audio sub-image that matches the current playback progress.

[0109] In an optional implementation, based on the aforementioned scheme, the information arrangement module 1130 can be configured to arrange audio sub-images and text information in separate rows in the display interface as follows: if multiple audio sub-images belonging to the same audio image are located in the same row in the display interface, then there is no gap between any two adjacent audio sub-images.

[0110] The specific details of each module in the aforementioned information processing device 1100 have been described in detail in the method section of the implementation. For any undisclosed details, please refer to the implementation content of the method section, and therefore will not be repeated here.

[0111] Exemplary embodiments of this disclosure also provide a computer-readable storage medium storing a program product capable of implementing the information processing methods described above. In some possible embodiments, various aspects of this disclosure may also be implemented as a program product including program code that, when run on an electronic device, causes the electronic device to perform the steps described in the "Exemplary Methods" section of this specification according to various exemplary embodiments of this disclosure.

[0112] The program product may be a portable compact disc read-only memory (CD-ROM) and include program code, and may run on an electronic device, such as a personal computer. However, the program product disclosed herein is not limited thereto. In this document, the readable storage medium may be any tangible medium that contains or stores a program that may be used by or in conjunction with an instruction execution system, apparatus, or device.

[0113] The program product may employ any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (a non-exhaustive list) of readable storage media include: electrical connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0114] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A readable signal medium may also be any readable medium other than a readable storage medium, capable of sending, propagating, or transmitting programs for use by or in conjunction with an instruction execution system, apparatus, or device.

[0115] The program code contained on the readable medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber, RF (Radio Frequency), etc., or any suitable combination thereof.

[0116] Program code for performing the operations of this disclosure can be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java and C++, and conventional procedural programming languages ​​such as C or similar languages. The program code can execute entirely on the user's computing device, partially on the user's computing device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing devices can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0117] Exemplary embodiments of this disclosure also provide an electronic device capable of implementing the above-described information processing method. Referring below... Figure 12 To describe an electronic device 1200 according to such an exemplary embodiment of the present disclosure. Figure 12The electronic device 1200 shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments disclosed herein.

[0118] like Figure 12 As shown, the electronic device 1200 can be represented as a general-purpose computing device. The components of the electronic device 1200 may include, but are not limited to: at least one processing unit 1210, at least one storage unit 1220, a bus 1230 connecting different system components (including storage unit 1220 and processing unit 1210), and a display unit 1240.

[0119] The storage unit 1220 stores program code that can be executed by the processing unit 1210, causing the processing unit 1210 to perform the steps described in the "Exemplary Methods" section above according to various exemplary embodiments of this disclosure.

[0120] Specifically, a program product stored on a computer-readable storage medium enables an electronic device to perform the following steps:

[0121] Obtain the information to be processed for display in the display interface, the information to be processed including at least one piece of text information and at least one piece of audio information;

[0122] The audio image corresponding to the audio information is determined, and the audio image is segmented to obtain audio sub-images;

[0123] Based on the single-line capacity parameter of the display interface, the audio sub-image and the text information are arranged in separate lines on the display interface to obtain the line arrangement result of the information to be processed.

[0124] In an optional implementation, based on the aforementioned scheme, the determination of the audio image corresponding to the audio information can be achieved through the following steps: determining the width of the audio image based on the audio duration corresponding to the audio information, wherein the width of the audio image is positively correlated with the audio duration; and determining the audio image that matches the audio information based on the pre-configured audio image height and audio image width.

[0125] In an optional implementation, based on the aforementioned scheme, the determination of the audio image matching the audio information based on the pre-configured audio image height and audio image width can be achieved through the following steps: adjusting the pre-configured audio image height according to the font size corresponding to the text information; and determining the audio image matching the audio information based on the adjusted pre-configured audio image height and audio image width.

[0126] In an optional implementation, based on the aforementioned scheme, the segmentation of the audio image to obtain audio sub-images can be achieved through the following steps: segmenting the audio image along the width direction of the image to obtain audio sub-images, such that the height of the audio sub-image is equal to the height of the audio image, and the width of the audio sub-image is less than the width of the audio image.

[0127] In one optional implementation, based on the aforementioned scheme, the segmentation of the audio image to obtain audio sub-images can be achieved through the following steps: determining the image segmentation length based on the font size corresponding to the text information; and segmenting the audio image based on the image segmentation length to obtain audio sub-images.

[0128] In an optional implementation, based on the aforementioned scheme, the arrangement of audio sub-images and text information in separate lines on the display interface based on the single-line capacity parameter of the display interface to obtain the line arrangement result of the information to be processed can be achieved through the following steps: determining the arrangement order of audio sub-images and text information corresponding to audio images based on the order in which text information and audio information are added in the information to be processed; arranging text information and audio sub-images corresponding to audio images in separate lines according to the arrangement order based on the single-line capacity parameter of the display interface to obtain the line arrangement result of the information to be processed.

[0129] In an optional implementation, based on the aforementioned scheme, after arranging the audio sub-images and text information in separate lines in the display interface, the following steps can also be performed: in response to a playback start operation applied to the coverage area of ​​any audio sub-image, the audio information corresponding to the audio image to which any audio sub-image belongs is played.

[0130] In an optional implementation, based on the aforementioned scheme, the audio sub-image is a dynamic image, and the following steps can also be performed: when the audio information is played, obtain the current playback progress of the audio information; determine the audio sub-image that matches the current playback progress from the audio sub-images contained in the audio image corresponding to the audio information; and dynamically display the audio sub-image that matches the current playback progress.

[0131] In an optional implementation, based on the aforementioned scheme, the arrangement of audio sub-images and text information in separate lines in the display interface can be achieved through the following steps: if multiple audio sub-images belonging to the same audio image are located in the same line in the display interface, then the interval between any two adjacent audio sub-images is set to be non-interval.

[0132] In the above information processing process, the audio images corresponding to the audio information are segmented to achieve adaptive line layout of audio images and text information. This not only applies to the display of larger audio images, but also saves interface space to a certain extent.

[0133] Storage unit 1220 may include a readable medium in the form of a volatile storage unit, such as random access memory (RAM) 1221 and / or cache memory 1222, and may further include a read-only memory (ROM) 1223.

[0134] Storage unit 1220 may also include a program / utility 1224 having a set (at least one) of program modules 1225, such program modules 1225 including but not limited to: operating system, one or more application programs, other program modules and program data, each or some combination of these examples may include an implementation of a network environment.

[0135] Bus 1230 can represent one or more of several types of bus structures, including a memory cell bus or memory cell controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local bus using any of the various bus structures.

[0136] Electronic device 1200 can also communicate with one or more external devices 1300 (e.g., keyboard, pointing device, Bluetooth device, etc.), and with one or more devices that enable a user to interact with the electronic device 1200, and / or with any device that enables the electronic device 1200 to communicate with one or more other computing devices (e.g., router, modem, etc.). This communication can be performed via input / output (I / O) interface 1250. Furthermore, electronic device 1200 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 1260. Figure 12 As shown, network adapter 1260 communicates with other modules of electronic device 1200 via bus 1230. It should be understood that, although... Figure 12 As not shown, other hardware and / or software modules can be used in conjunction with the electronic device 1200, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID (Redundant Arrays of Independent Disks) systems, tape drives, and data backup storage systems.

[0137] From the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, terminal device, or network device, etc.) to execute the method according to the exemplary embodiments of this disclosure.

[0138] Furthermore, the above figures are merely illustrative representations of the processes included in the methods according to exemplary embodiments of this disclosure, and are not intended to be limiting. It is readily understood that the processes shown in the above figures do not indicate or limit the temporal order of these processes. Additionally, it is readily understood that these processes may be executed synchronously or asynchronously, for example, in multiple modules.

[0139] It should be noted that although several modules or units for the device used to perform actions have been mentioned in the detailed description above, this division is not mandatory. In fact, according to exemplary embodiments of this disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0140] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and embodiments are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the claims.

[0141] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. An information processing method, characterized in that, The method includes: Obtain the information to be processed for display in the display interface, the information to be processed including at least one piece of text information and at least one piece of audio information; The audio image corresponding to the audio information is determined, and the audio image is segmented to obtain audio sub-images; Based on the single-line capacity parameter of the display interface, the audio sub-image and the text information are arranged in separate lines on the display interface to obtain the line arrangement result of the information to be processed. The step of determining the audio image corresponding to the audio information includes: Based on the attribute characteristics of the audio information, the size of the audio image is determined, and based on the size of the audio image, the audio image corresponding to the audio information is obtained; The step of arranging the audio sub-image and the text information in separate lines on the display interface based on the single-line capacity parameter of the display interface to obtain the line arrangement result of the information to be processed includes: Based on the order in which the text information and the audio information in the information to be processed are added, the arrangement order of the audio sub-image corresponding to the audio image and the text information is determined. Based on the single-line capacity parameter of the display interface, the text information and the audio sub-images corresponding to the audio images are arranged in rows according to the arrangement order to obtain the row arrangement result of the information to be processed.

2. The information processing method according to claim 1, characterized in that, Determining the audio image corresponding to the audio information includes: The width of the audio image is determined based on the audio duration corresponding to the audio information, and the width of the audio image is positively correlated with the audio duration; Based on the pre-configured audio image height and the audio image width, an audio image that matches the audio information is determined.

3. The information processing method according to claim 2, characterized in that, The step of determining the audio image that matches the audio information based on the pre-configured audio image height and the audio image width includes: Adjust the height of the pre-configured audio image according to the font size corresponding to the text information; Based on the adjusted pre-configured audio image height and the audio image width, an audio image that matches the audio information is determined.

4. The information processing method according to claim 1, characterized in that, The step of segmenting the audio image to obtain audio sub-images includes: The audio image is divided along the width direction of the image to obtain audio sub-images, such that the height of the audio sub-image is equal to the height of the audio image, and the width of the audio sub-image is less than the width of the audio image.

5. The information processing method according to claim 1, characterized in that, The step of segmenting the audio image to obtain audio sub-images includes: The image segmentation length is determined based on the font size corresponding to the text information; Based on the image segmentation length, the audio image is segmented to obtain audio sub-images.

6. The information processing method according to claim 1, characterized in that, After arranging the audio sub-image and the text information in separate lines on the display interface, the method further includes: In response to a playback start operation applied to the coverage area of ​​any audio sub-image, the audio information corresponding to the audio image to which the audio sub-image belongs is played.

7. The information processing method according to claim 6, characterized in that, The audio sub-image is a dynamic image, and the method further includes: When the audio information is played, the current playback progress of the audio information is obtained; Determine the audio sub-image that matches the current playback progress from the audio sub-images contained in the audio image corresponding to the audio information; The audio sub-images that match the current playback progress will be dynamically displayed.

8. The information processing method according to any one of claims 1-7, characterized in that, The step of arranging the audio sub-image and the text information in separate lines on the display interface includes: If multiple audio sub-images belonging to the same audio image are located in the same row of the display interface, then there is no gap between any two adjacent audio sub-images.

9. An information processing device, characterized in that, The device includes: The information acquisition module is used to acquire information to be processed for display in the display interface, the information to be processed including at least one piece of text information and at least one piece of audio information; The image segmentation module is used to determine the audio image corresponding to the audio information and segment the audio image to obtain audio sub-images; The information arrangement module is used to arrange the audio sub-image and the text information in separate lines on the display interface based on the single-line capacity parameter of the display interface, so as to obtain the line arrangement result of the information to be processed; The step of determining the audio image corresponding to the audio information includes: Based on the attribute characteristics of the audio information, the size of the audio image is determined, and based on the size of the audio image, the audio image corresponding to the audio information is obtained; The step of arranging the audio sub-image and the text information in separate lines on the display interface based on the single-line capacity parameter of the display interface to obtain the line arrangement result of the information to be processed includes: Based on the order in which the text information and the audio information in the information to be processed are added, the arrangement order of the audio sub-image corresponding to the audio image and the text information is determined. Based on the single-line capacity parameter of the display interface, the text information and the audio sub-images corresponding to the audio images are arranged in rows according to the arrangement order to obtain the row arrangement result of the information to be processed.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the information processing method according to any one of claims 1 to 8.

11. An electronic device, characterized in that, include: processor; as well as Memory for storing the executable instructions of the processor; The processor is configured to execute the information processing method according to any one of claims 1 to 8 by executing the executable instructions.

Images