Methods, systems, storage media, and electronic devices for converting galaxy images into audible sound.

Abstract

This invention provides a method and system for converting galaxy images into audible sound. By utilizing image processing, coordinate transformation, and other technologies, it generates sound signals that are coupled with the morphology of the target galaxy. This allows visually impaired patients or people with normal vision to perceive the morphological characteristics of galaxies or other similar celestial bodies in the universe through sound. Furthermore, the method and system of this invention are easy to implement, and the algorithms and programs used have fast computation speeds, enabling near real-time completion of the "image-sound conversion," generating and playing sound. The implementation cost is low, and the processing effect is good, making it suitable for widespread use.

Description

Technical Field

[0001] This invention belongs to the field of image and audio signal processing technology, specifically a method, system, storage medium, and electronic device for converting galaxy images into audio, and falls within the scope of the "image-to-sound conversion" technology field. Background Technology

[0002] In the interdisciplinary field of multidimensional perception of graphics and images, audio conversion and disability assistance, converting two-dimensional or three-dimensional graphic signals in reality into one-dimensional audio signals is a promising emerging assistive cognitive technology.

[0003] In traditional assisted cognitive technologies, image perception technology, combined with ranging devices such as LiDAR and millimeter-wave radar, has been widely applied in fields such as facial recognition, object recognition, intelligent vehicles, autonomous driving, and drone obstacle avoidance. Image perception and feature recognition primarily study the image features of objects in two-dimensional space, and many machine learning algorithms also operate in two-dimensional space, which is essential for images with many complex features. Even for relatively simple image recognition tasks like galaxy morphology classification in astronomy, dimensionality reduction can be achieved: two-dimensional galaxies can be unfolded in polar coordinates to obtain one-dimensional data, which can then be used for machine learning training to ultimately achieve a fast and accurate AI classification algorithm.

[0004] Besides machines, humans can also classify two-dimensional objects based on one-dimensional data by converting the one-dimensional data into audio data. For machines, recognizing one-dimensional data and sound signals is indistinguishable. However, for humans, it involves converting visual signals into auditory signals, and images into sound—a process known as "image-sound conversion." This dimensionality reduction operation is particularly beneficial for people with disabilities such as the blind or visually impaired, allowing them to identify different shapes of galaxies by discerning the loudness, pitch, and timbre of a sound, thus achieving "identifying shape by sound."

[0005] As is well known, bats in nature have evolved to "distinguish shapes by sound." While bats are visually blind, they can use ultrasonic waves and echolocation to identify prey and obstacles. Experiments have shown that bats' object recognition system (including vocal organs, ears, and echolocation computational brain circuits) can make very accurate identifications. In a sense, this system, capable of converting form into sound and distinguishing shapes by sound, is the bat's eye.

[0006] Humans are not born with an ultrasonic generator, but we can use lasers or millimeter-wave radar to calculate distances and use "sound-to-image conversion" and "sound-to-shape recognition" technologies to identify the shape and even color of objects. With short-term training, blind people can perceive the static and dynamic world around them entirely through hearing. Summary of the Invention

[0007] The technical objective of this invention is to convert the shapes of galactic objects in two-dimensional galaxy images into sound, providing a way for visually impaired people to perceive the universe through hearing.

[0008] To achieve the above-mentioned technical objectives, the present invention provides the following technical solution:

[0009] A method for converting galaxy images into audible sound, characterized by comprising the following steps:

[0010] Step 1: Purify galaxy images

[0011] Obtain the original image of the target galaxy, remove the contaminants from the original image, and obtain a pure image containing only the target galaxy;

[0012] Step 2: Draw the isoluminity contour map of the target galaxy.

[0013] In the clean image, draw the isoluminance contour lines of the target galaxy to obtain an isoluminance contour map;

[0014] Step 3: Perform polar coordinate expansion of the isoluminance contour map.

[0015] Using the center of the target galaxy's brightness as the origin of the polar coordinates, each ring of isoluminous contour lines is expanded in polar coordinates relative to the center of the target galaxy's brightness, including:

[0016] Step 31) Sample at unit angle intervals on each isoluminance contour line, and count the radial distance from each sampling point on the isoluminance contour line to the origin of polar coordinates and its corresponding angle to obtain the polar radius coordinates and polar angle coordinates of each sampling point in the polar coordinate system.

[0017] Step 32) Convert the polar radius coordinates and polar angle coordinates of each sampling point into the horizontal and vertical coordinates on the Cartesian coordinate system to obtain the position of each sampling point on the Cartesian coordinate system. Connect the sampling points located on the same isoluminance contour line in the Cartesian coordinate system to obtain the polar radius-polar angle curve corresponding to each isoluminance contour line.

[0018] Step 33) Modify the data type of the horizontal and vertical coordinates of the Cartesian coordinate system by replacing the polar radius with pitch and the polar angle with time, and transform the polar radius-polar angle curve obtained in step 32) into a pitch-time curve, wherein the pitch-time curve is an audio curve;

[0019] Step 4: Generate an audio signal based on the audio curve and send the audio signal to a sound playback device for playback.

[0020] Based on the above solutions, further improvements or preferred solutions include:

[0021] Furthermore, in step 1), the brightness center of the target galaxy is set at the center of the clean image.

[0022] Furthermore, the pollution sources mentioned in step 1) are cosmic rays, transient sources, and background or foreground galaxies other than the target galaxy, as well as stars and nebulae within the Milky Way.

[0023] Furthermore, the isoluminance contour map in step 2 has at least three levels of contour, which include the periphery, the disk surface, and the core region.

[0024] A system for converting galaxy images into audible sound, characterized by comprising:

[0025] The image reading module is used to receive the raw image containing the target galaxy and send it to the image purification module for processing;

[0026] The image purification module is used to identify and determine the target galaxy from the original image, remove the contaminants from the original image, and process it to obtain a pure image containing only the target galaxy.

[0027] The isoluminance contour drawing module analyzes the brightness information at each position on the clean image, connects adjacent points with equal brightness into a closed curve, and obtains the isoluminance contour of the target galaxy.

[0028] The polar coordinate expansion module is used to: sample along each isoluminance contour line at unit angle intervals; calculate the radial distance from each sampling point on the isoluminance contour line to the origin of the polar coordinates and its corresponding angle; after obtaining the polar radius coordinates and polar angle coordinates of each sampling point in the polar coordinate system, convert the polar radius coordinates and polar angle coordinates of each sampling point into the abscissa and ordinate coordinates of the Cartesian coordinate system to obtain the position of each sampling point in the Cartesian coordinate system; connect the sampling points located on the same isoluminance contour line in the Cartesian coordinate system sequentially to obtain the polar radius-polar angle curve corresponding to each isoluminance contour line; modify the data type of the abscissa and ordinate of the Cartesian coordinate system by replacing the polar radius with pitch and the polar angle with time, and convert the polar radius-polar angle curve into a pitch-time curve, which is an audio curve;

[0029] An audio signal generation module is used to generate a corresponding audio signal based on the audio curve.

[0030] A sound playback device is used to receive the audio signal and play a sound that is coupled to the shape of the target galaxy based on the audio signal.

[0031] A computer-readable storage medium storing a computer program, characterized in that the computer program causes a computer to execute the method for converting galaxy images into audible sound.

[0032] An electronic device, characterized in that it comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, it implements the method for converting galaxy images into audible sound.

[0033] The beneficial effects of this invention are:

[0034] This invention provides a method and system for converting galaxy images into audible sound, allowing visually impaired patients or people with normal vision to perceive the morphological characteristics of galaxies or other similar celestial bodies in the universe through sound. Furthermore, the method and system of this invention are easy to implement, and the algorithms and programs used have fast computing speeds, enabling them to complete the "image-to-sound conversion" almost in real time, generating and playing sound. The implementation cost is low, and the processing effect is good, making it suitable for widespread use. Attached Figure Description

[0035] Figure 1 The left image in the top row is the purified image of the galaxy, and the right image is the isoluminity contour map (containing 5 levels of contours); the left image in the bottom row is the Cartesian coordinate system obtained after polar coordinate expansion and the polar radius-polar angle curves corresponding to each isoluminity contour line in the coordinate system, with one period unfolded in the figure; the right image is the Cartesian coordinate system with the data type replaced and the tone-time curves of each tone.

[0036] Figure 2 Layout as follows Figure 1 The difference is Figure 1 It is a spiral galaxy with three spiral arms. Figure 2 It is a barred spiral galaxy with two spiral arms. This can be clearly seen from the audio curve: a spiral galaxy with three spiral arms has three peaks (high frequencies), while a barred spiral galaxy with two spiral arms has two peaks (high frequencies), which can be clearly perceived by people when converted into sound. Detailed Implementation

[0037] The present invention will now be described in further detail with reference to the accompanying drawings and specific embodiments.

[0038] Example 1:

[0039] A method for converting galaxy images into audible sound includes the following steps:

[0040] Step 1: Purify galaxy images

[0041] The original image of the target galaxy is acquired, and contaminants in the original image are removed, including cosmic rays, transient sources, and other background or foreground galaxies, stars and nebulae in the Milky Way, etc., to obtain a pure image containing only the target galaxy. The brightness center (or mass center) of the target galaxy is set at the center of the pure image to facilitate the generation of coordinates and isoluminance contours.

[0042] Step 2: Draw the isoluminity contour map of the target galaxy.

[0043] In the clean image, draw the isoluminance contour lines of the target galaxy to obtain an isoluminance contour map.

[0044] The isoluminance contour line is a closed curve connecting adjacent points of equal brightness in the diagram. In practice, the generated isoluminance contour map should ideally have at least three levels of contour, including the outer perimeter, the disk surface, and the core region. For example... Figure 1 The spiral galaxy with three spiral arms shown has five levels of contours, from the inside to the outside, represented by ①-⑤, on its isoluminity profile.

[0045] Step 3: Perform polar coordinate expansion of the isoluminance contour map.

[0046] Using the center of the target galaxy's brightness as the origin of the polar coordinate system, each ring of isoluminity contour lines is expanded in polar coordinates relative to the center of the target galaxy's brightness. The specific process is as follows:

[0047] Step 31) Sample at unit angle intervals (preset value) on each equal brightness contour line, and calculate the radial distance (polar radius) from all sampling points on each equal brightness contour line to the origin of polar coordinates and the angle (polar angle) of the sampling point, so as to obtain the polar radius coordinates and polar angle coordinates of each sampling point in the polar coordinate system.

[0048] Generally speaking, the radial distance corresponding to the outline of a high-brightness core region is small, while the radial distance corresponding to the outline of a low-brightness outer region is large.

[0049] Step 32) Convert the polar radius coordinates and polar angle coordinates of each sampling point into the x-coordinate and y-coordinate of the plane rectangular coordinate system to obtain the position of each sampling point in the plane rectangular coordinate system; in the plane rectangular coordinate system, connect the sampling points located on the same isoluminance contour line in the order of sampling to obtain the polar radius-polar angle curve corresponding to each circle of isoluminance contour line.

[0050] Step 33) Replace the polar radius with pitch and the polar angle with time, modify the data type of the horizontal and vertical coordinates of the Cartesian coordinate system, and convert the polar radius-polar angle curve obtained in step 32) into a pitch-time curve, wherein the pitch-time curve is an audio curve;

[0051] Step 4: Generate an audio signal based on the audio curve and send the audio signal to a sound playback device for playback.

[0052] At this point, the sound played by the audio playback device has a tone that has a specific coupling relationship with the shape of the target galaxy. Assuming that the peak value on the pitch-time curve is the high-pitched part and the trough value is the low-pitched part, people can distinguish the structural features of the galaxy by sound.

[0053] We downloaded galaxy images from the telescope database and conducted experiments following the steps of Example 1, obtaining the following results:

[0054] I. Results and Discussion:

[0055] 1) Based on the implementation scheme of Example 1, we recruited two groups of visually normal volunteers, Group A and Group B, with 10 volunteers in each group. Group B underwent 3 rounds of auditory training, while Group A underwent 10 rounds of auditory training on the audio of various galaxy forms. Afterwards, they were blindfolded and asked to identify new samples by sound. We found that Group B's recognition accuracy was around 60%, while Group A's accuracy was around 90%. This indicates that the recognition accuracy is closely related to the number of training sessions; a higher recognition accuracy can be achieved through a certain number of training sessions.

[0056] 2) As an aid for blind people learning astronomy, we artificially added timbre classifications, such as stringed instruments for spiral galaxies, drum sounds for elliptical galaxies, and piano sounds for irregular galaxies. This method achieved nearly 100% accuracy in identifying galaxy morphology types in blindfolded tests. Within galaxies of the same morphology, the accuracy of estimating galaxy ellipticity, number of arms, and substructure through "sound identification" essentially returned to the situation discussed in 1).

[0057] II. Outlook

[0058] In the near future, many new technologies will be proposed and applied to compensate for visual impairments, but "sound-to-image conversion" will be key to "sound-based image recognition." For congenitally blind children, this technology, combined with appropriate training, can allow them to "see" the graphics and even the words written by the teacher on the blackboard (assisted by OCR technology). This technology provides a two-dimensional world for the blind. If further enhanced with laser, millimeter-wave radar, and AI technologies to encode the distance of objects using sound, it will ultimately enable blind people to attend classes, learn, and live like sighted people. This invention's method allows visually impaired individuals to perceive the universe, thereby learning more about astronomy.

[0059] Example 2:

[0060] This embodiment provides an audible system for converting galaxy images into sound, which belongs to the same general inventive concept as Embodiment 1.

[0061] The system for converting galaxy images into audible sound mainly consists of an image reading module, an image purification module, an isoluminance contour drawing module, a polar coordinate unfolding module, an audio signal generation module, and a sound playback device, wherein:

[0062] The image reading module is used to receive the original image containing the target galaxy and send it to the image purification module for processing. It is equipped with a data transmission port or a network connection port.

[0063] The image purification module is used to identify and determine the target galaxy from the original image, remove the contaminants from the original image, and process it to obtain a pure image containing only the target galaxy.

[0064] The isoluminance contour drawing module is used to analyze and obtain the brightness information of each pixel position on the clean image, and connect adjacent points with equal brightness into a closed curve according to the preset brightness parameters to obtain the isoluminance contour of the target galaxy.

[0065] The polar coordinate expansion module is used to implement the following process:

[0066] Sampling is performed at unit angle intervals along each isoluminance contour line. The radial distance from each sampling point on the isoluminance contour line to the origin of polar coordinates and its corresponding angle are statistically analyzed. After obtaining the polar radius coordinates and polar angle coordinates of each sampling point in the polar coordinate system, the polar radius coordinates and polar angle coordinates of each sampling point are converted into abscissa and ordinate coordinates on a Cartesian coordinate system to obtain the position of each sampling point on the Cartesian coordinate system. Sampling points located on the same isoluminance contour line are connected sequentially on the Cartesian coordinate system to obtain the polar radius-polar angle curve corresponding to each isoluminance contour line. The polar radius is replaced with pitch, and the polar angle is replaced with time. The data type of the abscissa and ordinate of the Cartesian coordinate system is modified to convert the polar radius-polar angle curve into a pitch-time curve. The pitch-time curve is the audio curve.

[0067] An audio signal generation module is used to generate a corresponding audio signal based on the audio curve.

[0068] A sound playback device is used to receive the audio signal and play a sound that is coupled to the shape of the target galaxy based on the audio signal.

[0069] Example 3:

[0070] A computer-readable storage medium storing a computer program that causes a computer to perform an audible method for converting galaxy images into sound, as described in Example 1.

[0071] Example 4:

[0072] An electronic device is characterized by comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, it implements the method for converting galaxy images into audible sound as described in Embodiment 1.

[0073] In the embodiments disclosed in this application, a computer storage medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. Computer storage media include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, or any suitable combination thereof. More specific examples of computer storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0074] Furthermore, those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed in this application can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0075] The above are merely preferred embodiments of the present invention. The scope of protection of the present invention is not limited to the above embodiments. All technical solutions falling within the scope of the present invention's concept are within the scope of protection of the present invention. It should be noted that for those skilled in the art, any improvements and modifications made without departing from the principles of the present invention should be considered within the scope of protection of the present invention.

Claims

1. A method of sonification of a galaxy image into sound, characterized in that, The method comprises the following steps: Step 1, purifying a galaxy image An original image of a target galaxy is obtained, and a contaminant in the original image is removed to obtain a pure image of only the target galaxy; Step 2, drawing an isophotal contour map of the target galaxy An isophotal contour line of the target galaxy is drawn in the pure image to obtain an isophotal contour map; Step 3, polar coordinate expansion of the isophotal contour map Each isophotal contour line is expanded in polar coordinates with respect to the luminosity center of the target galaxy, comprising: Step 31) sampling at intervals of a unit angle on each isophotal contour line, and counting the radial distance of each sampling point on the isophotal contour line to the polar coordinate origin and the corresponding angle to obtain the polar radial coordinate and the polar angular coordinate of each sampling point in the polar coordinate system; Step 32) converting the polar angular coordinate and the polar radial coordinate of each sampling point into a horizontal coordinate and a vertical coordinate in a plane rectangular coordinate system to obtain the position of each sampling point in the plane rectangular coordinate system, and sequentially connecting the sampling points on the same isophotal contour line in the plane rectangular coordinate system to obtain a polar radial-polar angular curve corresponding to each isophotal contour line; Step 33) modifying the data types of the horizontal coordinate and the vertical coordinate of the plane rectangular coordinate system in the form of replacing the polar radial with a tone and replacing the polar angular with a time, converting the polar radial-polar angular curve obtained in step 32) into a tone-time curve, and the tone-time curve is an audio curve; Step 4, generating an audio signal based on the audio curve and sending the audio signal to a sound playing device for playing.

2. The method of claim 1, wherein the method further comprises: In step 1, the luminosity center of the target galaxy is set at the center position of the pure image.

3. The method of claim 1, wherein the method further comprises: In step 1, the contaminant is a cosmic ray, a transient source, and a background or foreground galaxy other than the target galaxy, a star and a nebula in the Milky Way.

4. The method of claim 1, wherein the method further comprises: In step 2, the isophotal contour map has at least three levels of contours, including a peripheral, a disk plane, and a core region.

5. An audiblezation system for converting a galaxy image into sound, characterized by, It comprises: An image reading module for receiving an original image containing a target galaxy and sending it to an image purifying module for processing; An image purifying module for identifying and determining the target galaxy from the original image, removing the contaminant in the original image, and processing to obtain a pure image of only the target galaxy; An isophotal contour line drawing module for analyzing the luminosity information of each position on the pure image, connecting adjacent points with equal luminosity into a closed curve to obtain an isophotal contour line of the target galaxy; The polar coordinate expansion module is configured to: sample each equal-luminance contour line at intervals of a unit angle, count the radial distance of each sampling point on the equal-luminance contour line to the polar coordinate origin and the corresponding angle, convert the polar angle coordinate and the polar radial coordinate of each sampling point into a horizontal coordinate and a vertical coordinate in a plane rectangular coordinate system after obtaining the polar radial coordinate and the polar angle coordinate of each sampling point in the polar coordinate system, obtain the position of each sampling point in the plane rectangular coordinate system, sequentially connect the sampling points on the same equal-luminance contour line in the plane rectangular coordinate system to obtain a polar radial-polar angle curve corresponding to each equal-luminance contour line, modify the data type of the horizontal coordinate and the vertical coordinate of the plane rectangular coordinate system in a manner of replacing the polar radial with a pitch and replacing the polar angle with a time, convert the polar radial-polar angle curve into a pitch-time curve, and the pitch-time curve is an audio curve; and the luminance center of the target galaxy is the polar coordinate origin. The audio signal generation module is configured to generate a corresponding audio signal according to the audio curve. The sound playing device is configured to receive the audio signal and play out a sound having a coupling relationship with the morphology of the target galaxy based on the audio signal.

6. A computer readable storage medium storing a computer program, characterized in that, The computer program enables a computer to execute the audible method for converting a galaxy image into a sound according to any one of claims 1-4.

7. An electronic device, comprising: The computer program product comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the audible method for converting a galaxy image into a sound according to any one of claims 1-4 when executing the computer program.

Images