Image sorting method, image sorting device, electronic device and readable storage medium

By obtaining the attribute values ​​and image information of the electronic device when it moves during shooting, and automatically sorting images, the problem of cumbersome sorting of users manually is solved, and fast and accurate picture sorting and viewing is achieved.

CN113343008BActive Publication Date: 2024-11-22VIVO SOFTWARE TECHNOLOGY CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202110729012.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-06-29
Publication Date
2024-11-22
Estimated Expiration
2041-06-29

AI Technical Summary

Technical Problem

After taking multiple photos, users need to sort them manually, which leads to a large workload and is inconvenient to view.

Method used

By obtaining the attribute values ​​and image information when the electronic device moves during shooting, calculating parameter changes, and automatically sorting the images with the initial image information.

Benefits of technology

It reduces the time and workload of users to sort multiple images, improves the accuracy and flexibility of sorting, and users do not need to rely on the shooting order, making it easier to view the captured pictures.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113343008B_ABST
    Figure CN113343008B_ABST
Patent Text Reader

Abstract

The present application discloses an image sorting method, an image sorting device, an electronic device and a readable storage medium, belonging to the technical field of communication equipment, wherein the image sorting method comprises: obtaining attribute values ​​or image information when the electronic device moves during shooting; obtaining parameter change values ​​according to the attribute values ​​or image information when the electronic device moves; and sorting the captured images according to the parameter change values ​​and the initial image information.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application belongs to the field of communication equipment, and specifically relates to an image sorting method, an image sorting device, an electronic device and a readable storage medium. Background Art

[0002] In order to be able to check files anytime and anywhere, users can take photos of the files they need to check in advance, so that they can check the files on their mobile phones.

[0003] After taking multiple photos of a document, the user needs to sort the multiple photos according to the page number of the document or according to the document context. When the number of photos is large, the user's workload for sorting the multiple photos is large, which brings great inconvenience to the user.

[0004] How to automatically sort photos has become an urgent problem to be solved. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide an image sorting method, an image sorting device, an electronic device and a readable storage medium, which can solve the problem of a large workload for users to sort multiple photos.

[0006] In order to solve the above technical problems, this application is implemented as follows:

[0007] In a first aspect, an embodiment of the present application provides an image sorting method, comprising:

[0008] Acquiring attribute values ​​or image information when the electronic device moves during the shooting process;

[0009] Acquiring parameter change values ​​according to attribute values ​​or image information when the electronic device moves;

[0010] The captured images are sorted according to the parameter change values ​​and the initial image information.

[0011] In a second aspect, an embodiment of the present application provides an image sorting device, the device comprising:

[0012] A first acquisition module, which acquires attribute values ​​and image information when the electronic device moves during the shooting process;

[0013] A second acquisition module, the second acquisition module acquires a parameter change value according to a property value or image information when the electronic device moves;

[0014] The first sorting module sorts the captured images according to the parameter change value and the initial image information.

[0015] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the image sorting method in the first aspect.

[0016] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the image sorting method of the first aspect are implemented.

[0017] In an embodiment of the present application, when a user uses an electronic device to take pictures, the electronic device can obtain the attribute value and the image information taken when the electronic device moves during the shooting process. Specifically, during the shooting process, if the user wants to take multiple photos, the electronic device is always in the state of acquiring images. When the user wants to take multiple images, for example, when taking pictures of the contents on multiple pages of a book, the user needs to flip the book to meet the shooting conditions of different pages. When the book is flipped, the image information obtained by the electronic device is obtained. When the book is flipped, the size of the book page will change, so that the dynamic change of the photographed object can be determined according to the image information, and then the sorting method of multiple pictures can be determined in combination with the initial image information. The initial image information refers to the information of the first captured image. During the shooting process, the user may also need to move the electronic device to shoot images at multiple positions, so during the shooting process, the user needs to drive the electronic device to move. By obtaining the attribute value when the electronic device moves, the moving position of the electronic device can be determined. When the electronic device takes the first photo, the electronic device and the corresponding background in the captured image have a relative position. After that, the position information of the background corresponding to the captured image can be determined according to the position information of each shooting of the electronic device, and the multiple pictures can be sorted according to the position information and the initial image information.

[0018] Of course, there may be situations where the user not only needs to move the electronic device, but also needs to obtain image information. Therefore, it is necessary to combine the image information and the parameter value when the electronic device moves to comprehensively determine the image sorting method.

[0019] After shooting, users do not need to spend time sorting pictures, which reduces the user's workload. This not only saves the user's time, but also makes it convenient for the user to view multiple pictures taken in order, which is conducive to improving the user's experience of using electronic devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 A flowchart of an image sorting method according to an embodiment of the present application is shown;

[0021] Figure 2One of the structural block diagrams of an image sorting device according to an embodiment of the present application is shown;

[0022] Figure 3 A second structural block diagram of an image sorting device according to an embodiment of the present application is shown;

[0023] Figure 4 A third structural block diagram of an image sorting device according to an embodiment of the present application is shown;

[0024] Figure 5 One of the structural block diagrams of an electronic device according to an embodiment of the present application is shown;

[0025] Figure 6 A second structural block diagram of an electronic device according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0026] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0027] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here. In addition, the "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally represents that the objects associated with each other are in an "or" relationship.

[0028] The image sorting method, image sorting device, electronic device, readable storage medium and chip provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.

[0029] In some embodiments of the present application, Figure 1 A flowchart of an image sorting method according to an embodiment of the present application is shown. The image sorting method comprises:

[0030] Step S102, obtaining attribute values ​​or image information when the electronic device moves during the shooting process;

[0031] Step S104, obtaining a parameter change value according to the attribute value or image information when the electronic device moves;

[0032] Step S106, sorting the captured images according to the parameter change value and the initial image information.

[0033] When a user uses an electronic device to take photos, the electronic device can obtain the attribute value and image information of itself when it moves during the shooting process. Specifically, during the shooting process, if the user wants to take multiple photos, the electronic device is always in the state of acquiring images. When the user wants to take multiple images, for example, when taking photos of the contents on multiple pages of a book, the user needs to turn the book to meet the shooting conditions of different pages. When the book is turned, the electronic device obtains the image information. When the book is turned, the size of the book page will change, so that the dynamic changes of the object being photographed can be determined based on the image information, and then the sorting method of the multiple pictures can be determined in combination with the initial image information.

[0034] The initial image information refers to the information of the first captured image.

[0035] During the shooting process, the user may need to move the electronic device to shoot images at multiple positions. Therefore, during the shooting process, the user needs to move the electronic device. By obtaining the attribute value of the electronic device when it moves, the moving position of the electronic device can be determined. When the electronic device takes the first photo, the electronic device and the corresponding background in the captured image have a relative position. Afterwards, the position information of the background corresponding to the captured image can be determined based on the position information of the electronic device each time it is taken, and multiple pictures can be sorted according to the position information and the initial image information.

[0036] The sorting method of the images can be determined according to the sorting rules, and the sorting rules can be preset rules. For example, when the images to be captured are multiple documents, the multiple documents are usually arranged from left to right or from top to bottom according to the coherence of the context. Of course, the multiple documents can also be multiple columns and / or multiple rows, and are also arranged from left to right or from top to bottom. Therefore, after determining the positions of the multiple images, the sorting method of at least two images can be determined according to the left-to-right sorting rule.

[0037] Of course, there may be situations where the user not only needs to move the electronic device, but also needs to acquire image information. Therefore, it is necessary to combine the image information and the parameter values ​​when the electronic device moves to comprehensively determine the image sorting method. After shooting, the user does not need to spend time sorting the pictures, which reduces the user's workload. It not only saves the user's time, but also makes it convenient for the user to view multiple pictures taken in order, which is conducive to improving the user's experience of using the electronic device.

[0038] Sorting at least two photos in the above manner is independent of the order in which they are taken, thereby improving reliability and accuracy of the sorting and being more convenient and flexible.

[0039] In a possible embodiment, the attribute value includes: acceleration and moving direction of the electronic device when it moves; the step of obtaining the parameter change value according to the attribute value when the electronic device moves includes: obtaining the instantaneous speed of the electronic device according to the acceleration; and obtaining the position change information of the electronic device relative to the background according to the moving direction.

[0040] In this embodiment, when the user moves the electronic device, the electronic device can obtain its own acceleration and moving direction, and the speed of the electronic device and the position change relative to the background can be determined based on the acceleration and moving direction. When the user takes multiple images, in order to ensure the clarity of the images, the user is basically in a stationary state during the shooting, so it can be considered that each time the user stops the electronic device from moving is the moment of taking a picture. Based on the acceleration and moving direction of the electronic device, the position of the electronic device when taking a picture can be obtained. After determining the positions of the multiple images, the captured images can be sorted according to the positions of the images, thereby improving the accuracy of the sorting process.

[0041] In a possible embodiment, the initial image information includes the initial spatial coordinates of the background area corresponding to the initial captured image, and the captured images are sorted according to the parameter change value and the initial image information, including: determining the target spatial coordinates of the background corresponding to other captured images in the captured image except the initial captured image according to the initial spatial coordinates, instantaneous speed and moving direction; and sorting the captured images according to the initial spatial coordinates and the target spatial coordinates.

[0042] In this embodiment, when the electronic device captures the first image, the position of the background corresponding to the first image is used as the initial spatial coordinate. When the user drives the electronic device to move to the positions of other images to be captured, the speeds of the two photographing positions approach 0, so the electronic device may be in a state of first accelerating and then decelerating when moving. The time integral of acceleration may determine the speed change of the electronic device within a certain period of time. The acceleration of the electronic device when it is in accelerated motion is in opposite directions to the acceleration when it is in deceleration. The maximum value of the moving speed of the electronic device is determined by determining the time point at which the acceleration direction changes, and then the moving distance of the electronic device between the two photographing positions may be determined according to the speed and time. After determining the moving distance and moving direction of the electronic device, the position information of the background corresponding to the second image relative to the background corresponding to the first image is determined, that is, the target spatial coordinates are determined. In this way, the target spatial coordinates of the backgrounds of the remaining multiple images may be determined. Exemplarily, the background corresponding to the second image is located on the left side of the background corresponding to the first image, and the distance between them is 1 meter.

[0043] Through the above method, the user saves time in sorting multiple pictures, and the user does not need to take pictures of the images in a certain order. Even if the user takes pictures in a disordered order, the pictures can be automatically sorted according to the position information of the images.

[0044] Exemplarily, in this embodiment, the acceleration and moving direction of the electronic device when it moves can be obtained based on the gyroscope.

[0045] In a possible embodiment, the step of acquiring a parameter change value according to image information includes: acquiring an area change value of the image to be captured according to the image information.

[0046] In this embodiment, if the image to be captured is a book, etc., the user needs to take pictures of the contents of different pages in the book, so the area change value of the page can be recorded during the shooting process. According to the area change value of the page, it can be determined whether a page turning operation has been performed, thereby determining the sequence of the page numbers of different images, that is, the purpose of sorting the captured images is achieved according to the image information, thereby improving the accuracy of the sorting process.

[0047] In a possible embodiment, the initial image information includes an initial image number, and the step of sorting the captured images according to the parameter change value and the initial image information includes: dividing the preset features in the captured image into at least two areas; obtaining the area change value of each of the at least two areas during the shooting process; determining the target image numbers of other captured images in the captured images except the initial image number according to the initial image number and the area change value of each area; and sorting the captured images according to the initial image number and the target image number.

[0048] In this embodiment, the preset features are divided into at least two areas, each area has its own area value, and the size change value of the image to be captured can be determined according to the change of the area value of each area, and then the numbering of the at least two images can be determined.

[0049] Exemplarily, the preset feature may be a book feature, and the book may be divided into two left and right areas in the display interface of the electronic device, and the two areas are separated by a folding portion of the book. If the area value of the right area changes from large to small, it indicates that the user has turned the page backward, and the number of the next photo taken may be increased by 1. If the area value of the left area changes from large to small, it indicates that the user has turned the page forward, and the number of the next group of photos taken may be decreased by 1. In the above manner, the numbers of multiple pictures can be accurately determined, so that at least two pictures can be sorted from small to large or from large to small according to the numbers, thereby improving the accuracy of the sorting process.

[0050] In a possible embodiment, after the captured images are sorted according to the parameter change values, the method further includes: re-sorting the sorted images according to text information in two adjacent images in the sorted images.

[0051] In this embodiment, after the images are sorted, in order to determine the accuracy of the sorting, the text information of two adjacent images in the sorted images is obtained, and then based on the contextual relationship of the text in the two adjacent images, it is determined whether the text in the two adjacent images is coherent and smooth, so that it can be determined whether the sorting of the two adjacent images is correct. If the context is incoherent, the order of the images is adjusted, that is, secondary sorting is performed to improve the accuracy of the image sorting.

[0052] In scenarios with multiple images, such as a batch of posters on a wall or a batch of papers on an academic exhibition wall, this method can effectively improve the efficiency of sorting after shooting. Without this method, users must judge the order of the images based on the context after shooting, which is very inconvenient for post-processing or viewing. This solution can save users from manually judging the context, sorting, converting to electronic documents, and other steps, and package them into an automatic solution. Moreover, this solution relies on the location information when the picture was taken for sorting, and recognizing the content and understanding the context in the text is only to assist in fine sorting. It has a wider applicability and does not require users to take pictures in a prescribed order, which is flexible.

[0053] When taking a batch of pictures in a book, they are automatically sorted, which reduces the burden of manual processing by the user at a later time, and there is no additional learning burden. The generated electronic document with page numbers is convenient for users to carry and view later.

[0054] In a possible embodiment, after the sorted images are sorted again, the method further includes: outputting document information including the sorted images.

[0055] In this embodiment, after sorting the images, document information including the secondarily sorted images may be generated. For example, the document information may be electronic document information. Users can conveniently check the electronic document information, thereby improving the convenience of users in obtaining file information.

[0056] Based on the changes in the position of the electronic device when shooting or the changes in the size and position of specific objects caused by the user turning pages, the serial order relationship between batches of pictures is intelligently inferred, so as to automatically arrange the order of batch-shot pictures and automatically form a set of electronic documents that provide page order, which is convenient for users to view later and improves the efficiency of users viewing batches of pictures.

[0057] In a possible embodiment, the image sorting method further includes: obtaining a distortion value of the captured image when a photo taking instruction is obtained; and outputting a prompt message indicating a photographing abnormality based on the distortion value being greater than a preset value.

[0058] In this embodiment, when the user is taking a photo, if the electronic device has a large deflection angle relative to the object to be photographed, the text and graphics in the photographed picture will be distorted. In order to ensure that the text and graphics in the photographed picture are clear and accurate, after the photographing command is input, the distortion value of the image in the photographed picture is determined. When the distortion value is greater than a preset value, it means that the currently acquired image is severely deformed. At this time, a prompt message of abnormal shooting is output to prompt the user that the shooting angle is abnormal and the shooting angle needs to be adjusted, which is helpful to assist the user in improving the quality of the photographed picture.

[0059] When the user adjusts the photographing angle of the electronic device, if the distortion value of the image is less than a preset value, the photographing function is executed.

[0060] For example, OCR (optical character recognition) technology can be used to obtain the text in the picture. If the shape of the text is significantly different from the preset shape, the character is framed. The border of a standard character should be a square or rectangle. If the border of the text in the picture is a diamond or trapezoid, and the difference is greater than the preset value, the current shooting angle is considered abnormal.

[0061] OCR technology has an orthodontic function. When the distortion value of an image is less than a preset value, but the image may still be distorted, the characters can be corrected through the orthodontic function of OCR itself.

[0062] In a possible embodiment, before obtaining the attribute value or image information when the electronic device moves during the shooting process, it also includes: based on the preset features included in the captured image, entering a sorting shooting mode, and continuing to obtain dynamic image information during the shooting process and / or the attribute value when the electronic device moves.

[0063] In this embodiment, if the user sorts all the photos taken when using the electronic device, it may deviate from the user's usage needs. Therefore, in order to accurately sort the photos that need to be sorted, when the shooting interface of the electronic device is turned on, when the electronic device acquires an image, it determines whether the acquired image includes preset features. If the preset features are included, the sorting shooting mode is entered. The photos taken in the sorting shooting mode will be sorted, and there is no need to sort all the photos in the electronic device, thereby improving the user's experience of using the electronic device.

[0064] Exemplarily, the preset features may be at least two images distributed in an array and / or at least two documents and / or books with text.

[0065] Users can start acquiring images by using the ultra-wide-angle camera. The ultra-wide-angle camera can acquire more images and improve the accuracy of detecting whether the surroundings include preset features.

[0066] In a possible embodiment, entering the sorting shooting mode based on the preset features included in the captured image specifically includes: outputting first prompt information based on the preset features included in the captured image; obtaining a first input instruction corresponding to the first prompt information, and entering the sorting shooting mode.

[0067] In this embodiment, when the captured image includes preset features, a first prompt message is outputted. The first prompt message may be whether to enter a sorting shooting mode. When a first input instruction corresponding to the first prompt message is obtained, the sorting shooting mode is entered. The first input instruction may be an instruction to enter the sorting shooting mode. The user may choose whether to enter the sorting shooting mode, that is, the user may choose a shooting mode, thereby improving the user's convenience in using the electronic device.

[0068] The second input instruction corresponding to the first prompt information is an instruction not to enter the sorting shooting mode. In this case, after the user takes multiple photos, the electronic device will not automatically sort at least two pictures.

[0069] In a possible embodiment, during the shooting process, if the moving direction of the electronic device changes by an angle greater than a set angle within a preset time, and / or the duration for which the preset feature is not included in the captured image exceeds a set duration, a second prompt message is output.

[0070] In this embodiment, if the moving direction of the electronic device changes significantly, and / or no images including preset features are acquired for a long time, it means that the user may not need to take pictures anymore. At this time, a second prompt message is output. The second prompt message may be information on whether to exit the sorting shooting mode. The user can click yes or no to output an instruction to confirm the sorting shooting mode or an instruction not to exit the shooting mode.

[0071] like Figure 2 As shown, in some embodiments of the present application, the image sorting device 200 includes:

[0072] A first acquisition module 210, the first acquisition module 210 acquires attribute values ​​and image information when the electronic device moves during the shooting process;

[0073] A second acquisition module 220, the second acquisition module 220 acquires a parameter change value according to a property value or image information when the electronic device moves;

[0074] The first sorting module 230 sorts the captured images according to the parameter change value and the initial image information.

[0075] In a possible embodiment, the attribute value includes: acceleration and moving direction of the electronic device when it moves; the second acquisition module 220 includes:

[0076] A first acquisition submodule, wherein the first acquisition submodule acquires an instantaneous speed of the electronic device according to the acceleration;

[0077] A second acquisition submodule, wherein the second acquisition submodule acquires position change information of the electronic device relative to the background according to the moving direction.

[0078] In a possible embodiment, the initial image information includes initial spatial coordinates of a background area corresponding to the initial captured image;

[0079] The first sorting module 230 includes:

[0080] a first determining submodule, wherein the first determining submodule determines the target spatial coordinates of the background corresponding to other captured images in the captured image except the initial captured image according to the initial spatial coordinates, the instantaneous speed and the moving direction;

[0081] A first sorting submodule is used to sort the captured images according to the initial space coordinates and the target space coordinates.

[0082] In a possible embodiment, the second acquisition module 220 includes:

[0083] The third acquisition submodule obtains the area change value of the image to be captured according to the image information.

[0084] In a possible embodiment, the initial image information includes an initial image number; the first sorting module 230 includes:

[0085] A separation submodule, which separates a preset feature in the captured image into at least two areas;

[0086] An acquisition submodule, wherein the acquisition submodule acquires an area value of each of at least two areas during the shooting process;

[0087] The second determining submodule determines the target image numbers of other captured images except the initial image in the captured images according to the number of the initial image and the area value of each region;

[0088] The second sorting submodule sorts the captured images according to the initial image number and the target image number.

[0089] In a possible embodiment, Figure 3As shown, the image sorting device 200 further includes:

[0090] The second sorting module 240 performs secondary sorting on the sorted images according to text information in two adjacent images in the sorted images.

[0091] like Figure 4 As shown, in a possible embodiment, the image sorting device 200 further includes:

[0092] The output module 250 is used to perform secondary sorting on the sorted images, and further comprises: outputting document information including the secondary sorted images.

[0093] The image sorting device in the embodiment of the present application can be a device, or a component, integrated circuit, or chip in a terminal. The device can be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. The non-mobile electronic device can be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0094] The image sorting device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0095] The image sorting device provided in the embodiment of the present application can implement various processes implemented in the above method embodiment, and will not be described again here to avoid repetition.

[0096] After shooting, users do not need to spend time sorting pictures, which reduces the user's workload. This not only saves the user's time, but also makes it convenient for the user to view multiple pictures taken in order, which is conducive to improving the user's experience of using electronic devices.

[0097] Sorting at least two photos in the above manner is independent of the order in which they are taken, thereby improving reliability and accuracy of the sorting and being more convenient and flexible.

[0098] like Figure 5 As shown, the embodiment of the present application also provides an electronic device 100, including a processor 110, a memory 109, and a program or instruction stored in the memory 109 and executable on the processor 110. When the program or instruction is executed by the processor 110, each process of the above-mentioned image sorting method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it is not repeated here. It should be noted that the electronic device in the embodiment of the present application includes the above-mentioned mobile electronic device and non-mobile electronic device.

[0099] Figure 6 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0100] The electronic device 100 includes but is not limited to components such as a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110.

[0101] Those skilled in the art will appreciate that the electronic device 100 may further include a power source 111 (such as a battery) for supplying power to various components. The power source 111 may be logically connected to the processor 110 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 6 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0102] Among them, the processor 110 is used to obtain the attribute value or image information when the electronic device moves during the shooting process; obtain the parameter change value according to the attribute value or image information when the electronic device moves; and sort the captured images according to the parameter change value and the initial image information.

[0103] Optionally, the processor 110 is configured to obtain the instantaneous speed of the electronic device based on the acceleration; and obtain the position change information of the electronic device relative to the background based on the moving direction.

[0104] Optionally, the processor 110 is used to determine the target spatial coordinates of the background corresponding to other captured images in the captured images except the initial captured image based on the initial spatial coordinates, instantaneous speed and moving direction; and sort the captured images according to the initial spatial coordinates and the target spatial coordinates.

[0105] Optionally, the processor 110 is used to obtain an area change value of the image to be captured according to the image information.

[0106] Optionally, the processor 110 is used to separate preset features in the captured image into at least two areas; obtain an area change value of each of the at least two areas during the shooting process; determine target image numbers of other captured images in the captured image except the initial image number according to the initial image number and the area change value of each area; and sort the captured images according to the initial image number and the target image number.

[0107] Sorting at least two photos in the above manner is independent of the order in which they are taken, thereby improving reliability and accuracy of the sorting and being more convenient and flexible.

[0108] It should be understood that in the embodiment of the present application, the input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 107 includes a touch panel 1071 and other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Other input devices 1072 may include but are not limited to a physical keyboard, a function key (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which will not be repeated here. The memory 109 can be used to store software programs and various data, including but not limited to applications and operating systems. The processor 110 can integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, the user interface, and the application program, etc., and the modem processor mainly processes wireless communication. It is understandable that the above-mentioned modem processor may not be integrated into the processor 110.

[0109] The embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned image sorting method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0110] The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0111] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned image sorting method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0112] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0113] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0114] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0115] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. An image sorting method, characterized in that: include: Get the property value of the electronic device when it moves during the shooting process; Acquiring a parameter change value according to the property value of the electronic device when it moves; Alternatively, obtaining image information of an image to be captured during the capturing process; obtaining a parameter change value according to the image information of the image to be captured; sorting the captured images according to the parameter change value and the initial image information, wherein the initial image information refers to the information of the first captured image; The attribute values ​​include: acceleration and moving direction of the electronic device when it moves; The step of obtaining a parameter change value according to the property value of the electronic device when it moves includes: Acquire the instantaneous speed of the electronic device according to the acceleration; acquiring position change information of the electronic device relative to the background according to the moving direction, obtaining the position of the electronic device when taking pictures according to the instantaneous speed of the electronic device and the position change information of the electronic device relative to the background, and sorting the captured images according to the position of the electronic device when taking pictures; The step of obtaining the parameter change value according to the image information of the image to be captured comprises: The area change value of the image to be captured is acquired according to the image information, and whether a page turning operation is performed is determined according to the area change value of the image to be captured, thereby determining the page number sequence of different captured images.

2. The image sorting method according to claim 1, characterized in that: The initial image information includes initial spatial coordinates of a background area corresponding to an initial captured image, and an attribute value when the electronic device moves during the capturing process is acquired; a parameter change value is acquired according to the attribute value when the electronic device moves, and the captured images are sorted according to the parameter change value and the initial image information, including: Determining target space coordinates of backgrounds corresponding to other captured images in the captured images except the initial captured image according to the initial space coordinates, the instantaneous speed and the moving direction; The captured images are sorted according to the initial space coordinates and the target space coordinates.

3. The image sorting method according to claim 1, characterized in that: The initial image information includes an initial image number, and the image information of the image to be captured is obtained during the capturing process; a parameter change value is obtained according to the image information of the image to be captured, and the steps of sorting the captured images according to the parameter change value and the initial image information include: Separate the preset features in the captured image into at least two areas; Obtaining an area change value of each of the at least two areas during the shooting process; Determining target image numbers of other captured images except the initial image number in the captured images according to the initial image number and the area change value of each region; sorting the captured images according to the initial image number and the target image number; Among them, the captured image is divided into two left and right areas in the display interface of the electronic device, and the two areas are separated by the folding part of the captured image. If the area value of the right area changes from large to small, it means that the user has turned the page back, and the number of the next group of captured images is increased by 1. If the area value of the left area changes from large to small, it means that the user has turned the page forward, and the number of the next group of captured images is reduced by 1.

4. An image sorting device, characterized in that: include: A first acquisition module, which acquires a property value of the electronic device when it moves during the shooting process; a second acquisition module, the second acquisition module acquiring a parameter change value according to a property value when the electronic device moves; or a first acquisition module, the first acquisition module acquiring image information of an image to be captured during the capturing process; a second acquisition module, wherein the second acquisition module acquires a parameter change value according to image information of the image to be captured; a first sorting module, which sorts the captured images according to the parameter change value and initial image information, wherein the initial image information refers to information of the first captured image; The attribute values ​​include: acceleration and moving direction of the electronic device when it moves; The second acquisition module is a step of acquiring a parameter change value according to the attribute value when the electronic device moves, including: A first acquisition submodule, wherein the first acquisition submodule acquires an instantaneous speed of the electronic device according to the acceleration; a second acquisition submodule, which acquires position change information of the electronic device relative to the background according to the moving direction, obtains the position of the electronic device when taking pictures according to the instantaneous speed of the electronic device and the position change information of the electronic device relative to the background, and sorts the captured images according to the position of the electronic device when taking pictures; The second acquisition module is a step of acquiring a parameter change value according to the image information of the image to be captured, and further includes: The third acquisition submodule obtains the area change value of the image to be captured according to the image information of the image to be captured, determines whether a page turning operation is performed according to the area change value of the image to be captured, and thus determines the page number sequence of different captured images.

5. The image sorting device according to claim 4, characterized in that: The initial image information includes the initial spatial coordinates of the background area corresponding to the initial captured image, and obtains the attribute value when the electronic device moves during the shooting process; Acquiring a parameter change value according to the property value of the electronic device when it moves; The first sorting module comprises: a first determining submodule, wherein the first determining submodule determines the target spatial coordinates of the background corresponding to other captured images in the captured image except the initial captured image according to the initial spatial coordinates, the instantaneous speed and the moving direction; A first sorting submodule is used to sort the captured images according to the initial space coordinates and the target space coordinates.

6. The image sorting device according to claim 4, characterized in that: The initial image information includes an initial image number, and the image information of the image to be captured is obtained during the capturing process; and the parameter change value is obtained according to the image information of the image to be captured; The first sorting module comprises: A separation submodule, wherein the separation submodule separates a preset feature in the captured image into at least two areas; An acquisition submodule, wherein the acquisition submodule acquires an area value of each of the at least two areas during the shooting process; a second determining submodule, wherein the second determining submodule determines target image numbers of other captured images except the initial image in the captured images according to the number of the initial image and the area value of each region; a second sorting submodule, wherein the second sorting submodule sorts the captured images according to the initial image number and the target image number; Among them, the captured image is divided into two left and right areas in the display interface of the electronic device, and the two areas are separated by the folding part of the captured image. If the area value of the right area changes from large to small, it means that the user has turned the page back, and the number of the next group of captured images is increased by 1. If the area value of the left area changes from large to small, it means that the user has turned the page forward, and the number of the next group of captured images is reduced by 1.

7. An electronic device, characterized in that: The method comprises a processor, a memory and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the image sorting method as claimed in any one of claims 1 to 3.

8. A readable storage medium, characterized in that: The readable storage medium stores a program or an instruction, and when the program or the instruction is executed by a processor, the steps of the image sorting method according to any one of claims 1 to 3 are implemented.