Method and apparatus for recycling electronic devices
Patent Information
- Application Number
- JP2025020653
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2013-01-30
- Filing Date
- 2025-02-12
- Publication Date
- 2025-05-16
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The prior art has failed to effectively solve the problem of consumers' difficulty in accessing recycling or reselling facilities during electronic equipment recycling and concerns about the security of equipment storage information.
A publicly accessible recycling robot (kiosk) is designed that visually analyzes electronic devices, determines their value and provides corresponding recycling considerations, and also has data erasure and equipment identification functions.
It realizes the safe recycling, identification and value evaluation of electronic equipment, reduces the difficulty of consumers' access to recycling facilities, and solves the security problem of equipment storage information.
Smart Images
Figure 00000000_0000_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates generally to recycling of electronic devices, and more particularly to a kiosk for visually analyzing an electronic device and offering compensation to the owner for recycling the electronic device. [Background technology]
[0002] The number of electronic devices used by a typical consumer has increased significantly. These devices include, but are not limited to, cell phones, PDAs, mp3 players, GPS devices, cameras, pagers, remote controls, cordless phones, and calculators. As new technologies and models of electronic devices are continually being introduced, many consumers frequently upgrade or replace one or more recyclable devices. In many cases, rather than disposing of an existing electronic device, consumers will discontinue use of the existing electronic device and begin using a new device. This situation may occur over several generations of such devices.
[0003] In addition to the electronic devices mentioned above, there are many other types of devices that are replaced relatively frequently, such as portable mobile electronic devices (e.g., cell phones, MP3 players) and non-portable electronic devices (e.g., computers, printers). In addition to electronic devices, there is content-based digital media, such as games or entertainment mass storage items on CDs, DVDs or cartridges (e.g., CDs, DVDs, Blu-ray). Such items need to be handled in an environmentally friendly manner, using recycling and / or proper disposal procedures. It would be convenient for electronic device owners to be able to recycle such devices or to properly dispose of such devices. There is currently little incentive for device owners to "do the right thing" with used devices. If the owner simply puts the device away when they stop using it, the opportunity for recycling or reuse by another party is lost. If the owner simply tosses the device in a regular trash bin, proper recycling or disposal of the device is hindered.
[0004] One particular problem associated with this phenomenon can be illustrated with the example of mobile phones. The number of mobile phone users in the world is over 3.6 billion, with an annual growth rate of 10%. Mobile handsets are replaced approximately every 18 months as new models are equipped with new features and new standards are rolled out. Wireless carriers also offer new phones below cost or for free as an incentive to consumers to sign up for lucrative two-year service contracts, resulting in a buildup of old phones. Old mobile phones and other mobile devices (pagers, PDAs) are now a threat to the environment. As of 2007, there were over 7.5 billion mobile phones waiting to be recycled in drawers or waste streams in the United States. Moreover, an additional 150 million mobile phones are added to the recycling queue each year. Once these devices are in the waste stream, they can leak lead, mercury, cadmium, arsenic, and other toxic substances into the water supply. In municipalities, waste is often incinerated, which results in the immediate release of these toxic substances into the air and back into the Earth's rainwater. A problem that needs to be solved is to allow the general public easy access to recycle or resell their mobile phones and other recyclable devices. Two reasons why mobile phones are not recycled or resold are the difficulty in accessing recycling or resale facilities and also the security concerns about the information stored on the mobile phone. In addition to mobile phones, similar problems exist with many other electronic devices. Summary of the Invention [Problem to be solved by the invention]
[0005] The prior art fails to recognize the problems associated with recycling mobile phones in a manner that is both attractive to consumers and financially rewarding to recyclers. Additionally, the prior art fails to provide an automated means for visually inspecting the LCD screen of a mobile phone to determine if damage has occurred to the LCD screen. Additionally, the prior art fails to provide an automated means for determining the authenticity of electronic devices submitted for recycling and compensation. [Means for solving the problem]
[0006] The present invention allows for the recycling, donation, trade-in and / or sale of mobile phones in a secure, publicly accessible location. In a mobile phone recycling embodiment, the present invention is used by mobile phone owners to submit their mobile phones for recycling via a recycling kiosk and receive compensation in some manner. Compensation may be distributed via cash, vouchers, credit or debit cards or other magnetic or electronic transaction methods.
[0007] In one embodiment, a method for collecting used electronic devices for recycling and refurbishing purposes employs a kiosk located at a publicly accessible location. The kiosk displays one or more transaction options. The method further includes interaction between a user and the kiosk display options. The kiosk display options may include powering the electronic device, testing and optical scanning, erasing stored data in the electronic device, and determining and accepting by the consumer a consideration for the value of the electronic device. The method may further include the consumer selecting, through interaction with the kiosk, various methods of consideration (e.g., dispensing cash or a redeemable discount voucher via a coupon, or debiting or crediting a credit card, making an electronic donation to a user-specified charity or charities, or other electronic payment methods).
[0008] One aspect of the invention is a method of valuing an electronic device and monetary compensation to a user for submission of the electronic device. The method includes placing the electronic device in an inspection area of a kiosk. The inspection area has a light. The method further includes imaging a display screen of the electronic device in a deactivated mode. Then, the method includes imaging a display screen of the electronic device in an activated mode. The light is turned off and an analysis image of the electronic device is generated. The method further includes imaging a display screen of the electronic device in an activated mode. The light is turned on and a first image of the electronic device is generated. Then, the method includes subtracting the first image of the electronic device from the analysis image of the electronic device to generate a subtraction image of the electronic device. The subtraction image is compared to the image of the electronic device in the deactivated mode to determine if the display screen of the electronic device is defective and define an analyzed electronic device. Finally, the method includes determining a value of the analyzed electronic device. The method may also include automatically binning the electronic device after determining the value of the analyzed electronic device.
[0009] The kiosk of the method includes a housing. The housing includes a user interface on an exterior surface of the housing for input of information by a user and includes an upper dome and a lower dome. The upper dome and the lower dome include a plurality of mirrors. The kiosk further includes an upper chamber camera, a lower chamber camera, and a transparent surface. The kiosk further includes a processor. The processor is disposed within the housing and in communication with the at least one camera. The processor is configured to identify a brand and model number of the electronic device based on at least one of the information from the user and an image from the at least one camera. The processor is configured to determine a value of a monetary consideration for the electronic device.
[0010] Another aspect of the invention is a method of analyzing an electronic device and monetary consideration to a user for submission of the electronic device. The method includes placing the electronic device within an inspection area of a kiosk. The inspection area has a camera. The method further includes imaging a portion of the electronic device, the portion including a periphery of the electronic device, resulting in a periphery image. The method further includes inspecting the periphery image of the electronic device obtained by at least one camera located within the inspection area to determine if a display screen of the electronic device is defective, thereby defining an analyzed electronic device. Finally, the method includes determining a value of the analyzed electronic device.
[0011] The kiosk of the method includes a housing, a user interface provided on an exterior surface of the housing for inputting information by a user, and an upper dome and a lower dome. The upper dome and the lower dome include a plurality of mirrors. The kiosk further includes an upper chamber camera, a lower chamber camera, and a transparent surface. The kiosk also includes a processor. The processor is provided within the housing and in communication with the at least one camera, the processor configured to identify a brand and model number of the electronic device based on at least one of the information from the user and an image from the at least one camera. The processor is configured to determine a value of a monetary consideration for the electronic device.
[0012] In the method, the information from the peripheral image further includes a model name and a location of the LED aperture. Additionally, the processor is configured to automatically adjust to a rectangular shape for the peripheral image. The peripheral image includes a 360-degree image. The information from the peripheral image includes a location of a USB port, a location of a volume control button, a location of a camera button, and a location of a power on / off button. The information from the peripheral image also includes a location of a camera lens and a logo of the electronic device.
[0013] Yet another aspect of the invention is a method for analysis of an electronic device and monetary compensation to a user for submitting the electronic device. The method includes placing the electronic device in an inspection area of a kiosk. The inspection area has a light. The method further includes imaging a display screen of the electronic device with the light of the inspection area illuminating the display screen of the device. The method then includes imaging the display screen of the electronic device with the light of the inspection area turned off to generate an analysis image of the electronic device. The method then includes subtracting the analysis image of the electronic device from a first image of the electronic device to generate a composite image of the electronic device. The subtraction image is compared to a training image of the electronic device. If the electronic device is found to be fake by a photo printed on a cardboard under the glass where the LCD is normally located, there is no electronic component in the electronic device. If the light is off, there is no light coming from the screen. By performing some processing on the first image and detecting that the first image has multiple colors and color variations on the display screen area but no light emission from the first image, the method assumes that the electronic device is fake. The method also explicitly trains the fake display electronic device since the fake display electronic device will usually have the same picture in the LCD area. Finally, the method includes determining a value of the analyzed electronic device. The method may also include automatically binning the electronic device after determining the value of the analyzed electronic device.
[0014] The method also determines crack detection on a display screen. Crack detection relates to detecting if there are multiple color variations in an electronic device. If the method determines that the actual crack in the glass is not available in the imaging because it is confused with a photograph of the underside of the glass, some kind of color entropy metric helps distinguish one crack from another (a crack in glass does not produce multiple different colors).
[0015] Yet another aspect of the invention is a method for determining authenticity of an electronic device by analysis of the electronic device and providing a monetary reward to a user for submitting the electronic device if the electronic device is authentic. The method includes placing the electronic device within an inspection area of a kiosk. The inspection area has a light. The method also includes imaging the electronic device. The light of the inspection area is turned on to generate a first image. The method also includes imaging the electronic device. When the light of the inspection area is turned off, a second image of the electronic device is generated. The method also includes generating a composite image of the electronic device from the first image and the second image. The composite image is generated to resemble an image of the electronic device when the display screen is off. The method also includes comparing the composite image to training images of a plurality of electronic devices to determine authenticity of the electronic device. The training images include display screens used by fraudulent electronic devices.
[0016] The method may further include detecting cracks in the display screen.A color entropy metric may also be used in the method.
[0017] Yet another aspect of the present invention is a dome-shaped device. The dome-shaped device includes an upper dome and a lower dome. The upper and lower domes include a plurality of walls. The plurality of walls are constituted by mirrors. The dome-shaped device further includes a transparent surface and at least one camera. The camera can obtain a 360 degree view of an electronic device placed within the dome-shaped device. The upper dome preferably includes an upper chamber camera. The lower dome preferably includes a lower chamber camera. Preferably, the upper dome and lower dome cameras, respectively, in combination with the plurality of mirrors, obtain an image of the device placed on the transparent surface. Preferably, the upper dome and lower dome cameras, respectively, in combination with the plurality of mirrors, obtain a 360 degree view of the electronic device placed on the transparent surface. Each of the upper dome and lower dome cameras is movable. The present invention provides, for example, the following: (Item 1) 1. A method for analyzing a submission of an electronic device for monetary consideration to said electronic device and a user, comprising: placing an electronic device within an inspection area of a kiosk, the inspection area having a light source; imaging the electronic device to generate a first image, the light source in the inspection area being on; and imaging the electronic device to generate an analysis image of the electronic device, the light in the inspection area being off; subtracting the analysis image of the electronic device from the first image of the electronic device to generate a composite image of the electronic device; comparing the composite image of the electronic device to a plurality of training images of electronic devices to identify the electronic device and determine if the electronic device is defective to define an analyzed electronic device; determining a value of the analyzed electronic device; A method comprising: (Item 2) 2. The method of claim 1, further comprising automatically binning the electronic device after determining the value of the analyzed electronic device. (Item 3) 2. The method of claim 1, further comprising multiplying the analysis image by a multiplier to take into account any brightness changes of the screen. (Item 4) 1. A method for analyzing a submission of an electronic device for monetary consideration to said electronic device and a user, comprising: imaging a portion of an electronic device, the portion including a display screen of the electronic device, the imaging resulting in a partial image; imaging the portion of the electronic device, the portion including the display screen of the electronic device, where a lit image is obtained when the environment is lit; inspecting the partial image of the electronic device obtained by at least one camera positioned within an inspection area to determine dimensions of the electronic device; inspecting the illuminated image of the electronic device to determine if there are any defects in a screen area of the electronic device to define an analyzed electronic device; determining a value of the analyzed electronic device; A method comprising: (Item 5) The kiosk includes: Housing and a user interface provided on an exterior surface of the housing for inputting information by the user; an upper chamber and a lower chamber; Further comprising: the upper chamber includes a plurality of mirrors, an upper chamber camera, a lower chamber camera, a transparent surface, and a processor, the processor being disposed within the housing and in communication with the at least one camera, the processor being configured to identify a brand and model number of the electronic device based on at least one of the information from the user and the image from the at least one camera, and the processor being configured to determine a monetary value of the electronic device. The method according to any one of items 1 to 4. (Item 6) 5. The method of claim 4, wherein the information from the partial image includes a position of the camera lens of the electronic device. (Item 7) 5. The method of claim 4, wherein the electronic device comprises one of a mobile phone, a tablet computer, or an e-reader. (Item 8) 1. A method for analyzing a submission of an electronic device for monetary consideration to said electronic device and a user, comprising: placing an electronic device within an inspection area of a kiosk, the inspection area having a camera; imaging the electronic device to generate a contour image of the electronic device; generating a plurality of parameters of the electronic device based on the contour image; comparing the plurality of parameters of the contour image to a plurality of training images of electronic devices to identify the electronic device; A method comprising: (Item 9) 9. The method of claim 8, wherein the plurality of parameters includes dimensions of the electronic device. (Item 10) 9. The method of claim 8, wherein generating a plurality of parameters of the electronic device includes determining a size of a side of the electronic device. (Item 11) 9. The method of claim 8, further comprising generating at least one illuminated image of the electronic device to determine a texture of the electronic device. (Item 12) 9. The method of claim 8, further comprising determining a value of the electronic device. (Item 13) The kiosk includes: Housing and a user interface provided on an exterior surface of the housing for inputting information by the user; an upper chamber and a lower chamber; Further comprising: the upper chamber includes a plurality of mirrors, an upper chamber camera, a transparent surface, and a processor, the processor being disposed within the housing and in communication with the at least one camera; The method according to item 8. (Item 14) Item 14. The method of item 13, wherein the processor is configured to identify a brand and model number of the electronic device based on at least one of the information from the user and the image from the at least one camera, and the processor is configured to determine a monetary value for the electronic device. (Item 15) 1. A method for analyzing a submission of an electronic device for monetary consideration to said electronic device and a user, comprising: placing the electronic device within an inspection area; imaging the electronic device in a first predetermined lighting environment to generate a first image; imaging the electronic device in a second predetermined lighting environment to generate a second image; generating a composite image of the electronic device from the first image and the second image, the composite image being generated to resemble an image of the electronic device as it would be if the display screen was off; and comparing the composite image to training images of a plurality of electronic devices to determine an identity of the electronic device; A method comprising: (Item 16) Item 16. The method of item 15, wherein the electronic device comprises one of a mobile phone, a tablet computer, or an e-reader. (Item 17) 1. A method of analyzing an electronic device to determine authenticity of the electronic device, and providing monetary consideration to a user for submission of the electronic device if the electronic device is authentic, comprising: placing an electronic device within an inspection area of a kiosk, the inspection area having a light; imaging the electronic device, turning on the light in the inspection area to generate a first image; imaging the electronic device, turning off the light in the inspection area to generate an analysis image of the electronic device; Determining that a display screen of an electronic device includes a plurality of colors but is not emitting light; determining that the electronic device is not authentic; and A method comprising: (Item 18) The kiosk includes: Housing and a user interface provided on an exterior surface of the housing for inputting information by the user; an upper chamber and a lower chamber; Further comprising: the upper chamber includes a plurality of mirrors, an upper chamber camera, a lower chamber camera, a transparent surface, and a processor, the processor being disposed within the housing and in communication with the at least one camera, the processor being configured to identify a brand and model number of the electronic device based on at least one of the information from the user and the image from the at least one camera, and the processor being configured to determine a monetary value of the electronic device. Item 18. The method according to item 17. (Item 19) Item 18. The method of item 17, further comprising using a color entropy metric. (Item 20) Item 18. The method of item 17, further comprising detecting cracks in the display screen. [Brief description of the drawings]
[0018] [Figure 1] FIG. 1 is a perspective view of a recycling kiosk. [Figure 1A] FIG. 2 is a front view of the recycling kiosk of FIG. 1. [Figure 1B] FIG. 2 is a front partial view of the recycling kiosk of FIG. 1. [Figure 1C] FIG. 2 is a front partial view of the recycling kiosk of FIG. 1. [Diagram 2] FIG. 2 is a partial view of an electrical connector wheel. [Diagram 3] FIG. 2 is a perspective view of the internal components of the kiosk. [Figure 3A] FIG. 2 is a perspective view of the internal components of the kiosk. [Figure 3B] FIG. 2 is a perspective view of the internal components of the kiosk. [Figure 3C] FIG. 2 is a perspective view of the internal components of the kiosk. [Figure 4] FIG. 13 is a partial view of the phone on the inspection plate of the kiosk. [Figure 4A] FIG. 13 is a partial view of a phone being moved into a kiosk. [Figure 4B] FIG. 13 is a partial view of a phone being moved into a kiosk. [Figure 4C] FIG. 1 is a partial view of how phones are binned into a kiosk. [Diagram 5] FIG. 2 is a block diagram of the components of a recycling kiosk. [Figure 6] FIG. 2 is a block diagram of the components of a recycling kiosk. [Figure 7] FIG. 2 is a partial view of an inspection area of the kiosk. [Figure 8] FIG. 2 is a partial view of a camera within the dome of a kiosk. [Figure 9] FIG. 1 is a partial view of a phone within an inspection area of a kiosk. [Figure 10] An image of a cell phone in its illuminated state (light on). [Figure 11] 1 is an image of a mobile phone in an unlit state. [Figure 12] 13 is an image of the subtraction results for a lit and unlit phone. [Figure 13] 1 is an image of a training image of a mobile phone with the screen not turned on. [Figure 14] Graph showing intensity profile from above, illustrating the match (spike lines at 211 are text regions, not present in the training images). [Figure 15] An image of the fraudulent cell phone in a illuminated state (when the light in the test area is on), showing a photo printed on cardboard and placed under the display screen glass instead of the LCD. [Figure 16] Shows an image of the rogue cell phone in an unlit state (with the light in the inspection area turned off) and not displaying anything. [Figure 17] An image of a genuine cell phone with a crack in the display screen. [Figure 18]1 is a flow chart of a method for recycling electronic devices. [Figure 19] 1 is a flow chart of a method for recycling electronic devices. [Figure 20] 1 is a flow chart of a method for recycling electronic devices. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0019] According to the present invention, an automated analysis of an electronic device can be performed to determine if the device is damaged to ascertain its value when recycled. The automated analysis is preferably performed using a kiosk or recycling machine. The kiosk has an inspection area including an upper chamber and a lower chamber. Preferably, each chamber has a camera. The kiosk also has a transparent plate between the inspection areas, which allows viewing of the underside of the electronic device placed on the transparent plate. Each chamber preferably has a number of mirrors that provide multiple views of the electronic device within the inspection area. The mirrors allow for a multi-dimensional view of the electronic device placed on the transparent plate to be obtained. Preferably, the mirrors allow for a 360 degree view of the electronic device placed on the rotatable transparent plate to be obtained. Preferably, the mirrors allow for the height, width and / or length of the electronic device to be obtained.
[0020] Cell phones are preferably classified into three basic shapes: 1) a flip phone or clamshell type (e.g., MOTOROLA RAZR), 2) a slider phone that exposes a keyboard or screen (e.g., MOTORLA DROID), and 3) a bar phone (e.g., Apple iPHONE or Research in Motion BLACKBERRY). The present invention may also be used with a network of kiosks in public spaces. These kiosks perform a combination of recycling process steps that receive, identify, visually inspect, electrically test, electrically wipe, grade quality, containerize (bag), label, and inventory recyclable electronic devices. Each kiosk determines some form of compensation to the device owner. This compensation preferably takes the form of a direct payment, a credit on an account, a donation to a charity, a discount coupon for a future purchase, or some similar form of compensation. The device owner has the option to accept the offered compensation or reject the transaction and remove the device.
[0021] In the following description, a mobile phone is provided as an example, however, one of ordinary skill in the relevant art will recognize that the system may be implemented with any number of other devices having an LCD screen without departing from the spirit and scope of the system.
[0022] As shown in Figures 1, 1A, 1B and 1C, a kiosk for recycling and providing monetary compensation for electronic devices is generally indicated by the reference numeral 100. The electronic device may be a smart phone, tablet computer, IPOD device, MP3 player, GPS device, e-reader, etc. Kiosk 100 has a housing 105 in the shape of a pseudo-cuboid. Kiosk 100 is preferably a vending machine of a typical size and shape (e.g., a soda machine, coin changer, can recycling machine, or other vending machine). A header 103 allows for marketing and video. An access door 130 in a forward body region 131 allows access to an inspection area 106 for electronic devices. A display screen 115 is provided at the front of housing 105. Display screen 115 provides information to a user and functions as a user interface in touch screen embodiments. Also preferably provided external to the housing 105 are a label printer 125, a coupon dispenser 126, a receipt printer 127, and a cash or card dispenser 128. The external housing is also provided with a thumbprint reader.
[0023] The kiosk 100 allows for an automated visual analysis of the electronic device, which can identify the electronic device and determine if the electronic device is damaged in order to ascertain the recycling value of the electronic device. Additionally, the kiosk 100 allows for an electrical analysis of the electronic device. As shown in FIG. 2, the kiosk 100 includes a carousel 500 that includes a plurality of electrical connectors 505a-505y. Each of the electrical connectors 505 has a unique connection plug for removable connection to an electronic device. Each of the electrical connectors 505a-505y has a cartridge that is removably secured within the carousel 500. Thus, a new electrical connector 505 can be replaced with an old electrical connector 505. Additionally, the kiosk 100 is designed to allow for an automated removal of the electrical connectors 505 using a removal mechanism 511.
[0024] As shown in Figures 3, 3A, 3B and 3C, the internal mechanism 101 of the kiosk 100 includes an upper chamber 520, a lower chamber 530, a binning plate 540, a transparent plate 545, a door 550, a bin 555 and a carousel 500. Preferably, the carousel 500 can hold about 25 electrical connectors 505. The electrical connectors 505 are replaceable, so that they can easily accommodate changes in USB and other similar connections. As shown in Figure 3B, the mobile phone 150 is placed on the transparent plate 545 and moved to the inspection area 106 in the upper chamber 520 and the lower chamber 530. Both the upper and lower chambers preferably have a bell-like shape. As shown in Figure 3C, the mobile phone is moved between the upper chamber 520 and the lower chamber 530 for visual analysis. The transparent plate is preferably constructed of glass, a transparent plastic material, which allows the imaging components in the upper and lower chambers 520, 530 to obtain multiple view images of the mobile phone 150. A 3D profile of the mobile phone is preferably generated to perform a visual analysis of the mobile phone's identity and condition. After the visual analysis is completed, the transparent plate 545 is moved out from between the upper and lower chambers 520, 530.
[0025] 4, 4A, 4B and 4C show the automated movement and binning of electronic devices 150 within the internal mechanism 101 of the kiosk 100. As shown in FIG. 4, the door 550 is lowered and placed on the transparent plate 545, and then the door 550 is moved with the mobile phone 150 placed on it. As shown in FIG. 4A, when the transparent plate 545 moves inward, the mobile phone is blocked by the door 550 and engages with the binning plate 540 as it starts to fall into the opening created by the inward movement of the transparent plate 545. As shown in FIG. 4B, when the mobile phone is placed on the binning plate 540, the binning plate 540 slowly moves down on one side and opens into the bin 555. As shown in FIG. 4C, the mobile phone 150 slowly falls into the bin 555 through the opening 556, where the mobile phone 150 is secured and later collected. This entire process is performed at a speed that avoids damage to the electronic devices being recycled.
[0026] Kiosk 100 is a typical size and shape of a vending machine (e.g., a soda machine, coin changer, can recycling machine, or other vending machine). A housing 105 of kiosk 100 protects the internal mechanisms 101 and secures electronic devices submitted for recycling. Housing 105 is preferably constructed of a metallic material (e.g., steel or aluminum) to prevent authenticated access to kiosk 100.
[0027] The inspection area 106 is preferably designed to allow detailed visual inspection of electronic devices (e.g., tablet computers, e-readers, MP3 players, PDAs). The size of the inspection area 106 is preferably 30 centimeters ("cm") long, 30 cm wide, and 20 cm high. The walls of the inspection area are preferably white and / or mirrored to allow imaging of the electronic device.
[0028] The connection from the kiosk 100 and to the remote computer is preferably a single connection to a communications network (e.g., the Internet) via wired LAN, wireless LAN, cellular, or any other proprietary communications system. The kiosk 100 preferably includes a processor 160. The processor 160 processes information obtained from the mobile phone and controls the components of the kiosk 100. The processor 160 is preferably a standard personal computer ("PC") or other type of embedded computer running any operating system (e.g., Linux or MACOS). The processor 160 is most preferably a small form factor PC with an integrated hard disk drive ("HDD"), a central processing unit ("CPU"), and a universal serial bus ("USB") port that communicates with the other components of the kiosk 100. One most preferred CPU is a DELL PC OPTIPLEX780. Alternatively, the processing means is a microprocessor with a separate HDD, a power supply, and a standalone motherboard that interfaces with the other components of the kiosk 100. Kiosk 100 preferably includes memory 161 or other storage device (eg, a disk drive) for storing executable applications, testing software, databases, and other software necessary for the operation of recycling kiosk 100 .
[0029] The external communications components for kiosk 100 preferably include a wired Ethernet to provide a connection to the Internet, or alternatively, the external communications components include a wireless modem (e.g., GSM, CDMA, 3G and 4G technologies for data communications).
[0030] As shown in Figures 7-9, visual inspection of the electronic device (e.g., a mobile phone 150) in the inspection area 106 is preferably performed by at least one camera 610 in the upper chamber 520. The lower chamber 530 also preferably has at least one camera or other imaging component (e.g., a scanner). Alternatively, visual inspection is performed by multiple cameras. A preferred camera 610 is a 1 megapixel machine vision camera. If a single camera 610 is used in the inspection area 106, the camera 610 is preferably movable, thereby increasing the field of view of the inspection area 106 when inspecting the electronic device 150 (e.g., a mobile phone placed on a transparent plate 545). The camera 161 is preferably movable. Preferably, the camera 610 is positioned to image the LCD screen 153 of the electronic device 150 to determine if there is any damage to the LCD screen 153. The inner surfaces of the upper and lower chambers 520, 530 preferably include mirrors 615 to optimize viewing of the electronic device placed in the inspection region 106. As shown in FIG. 9, a reflection 150' of a cell phone 150 is shown. The camera 610 is also preferably movable to image the data port of the electronic device to determine the type of electrical connector 505 of the electronic device for performing an electrical analysis of the electronic device. Alternatively, the entire inner surface of the upper and lower chambers 520, 530 is mirrored to optimize imaging of the electronic device. Alternatively, the camera(s) is CCD or CMOSS.
[0031] FIG. 6 is a block diagram of the major components of the kiosk 100. The processor 160 preferably communicates with the other components of the kiosk 100. The memory 161 preferably contains a database of information on multiple mobile phones (e.g., images, physical characteristics, prices, and other similar information). The external communications 167 preferably communicates with a network through a wireless connection or Ethernet to send and receive information to and from remote locations. The power supply 170 is preferably received through a plug-in connection to a wall outlet. The mechanical components 165 include the electrical connectors, carousel 500, transparent plate 545, binning plate 540, door 550, and other similar components. The camera(s), electrical connectors, and user interface interact with the processor 160 as described above. FIG. 5 shows the interior rear of the recycling kiosk 100. As shown, the processor 160 is preferably a personal computer and includes a spare battery 170 a , a wireless connection 167 for external communications, an electrical connection 140 , a receipt dispenser 104 , and a display screen 115 .
[0032] The processor 160 identifies the electronic device 150 submitted for recycling using the visual inspection and information from the user interface. The processor 160 also determines an appropriate electrical connector 505 for connection to a data port of the electronic device 150 using information obtained during the visual inspection or from the user interface. The processor 160 also directs and receives information from an electrical analysis of the electronic device 150 performed with the electrical connector 505 connected to the data port of the electronic device 150. The processor also preferably determines a monetary value for the submitted electronic device 150 based on the visual inspection, optionally the electrical analysis, and data stored within the kiosk's memory 161 or information obtained externally via the external communication component 167.
[0033] A flow chart of a preferred recycling method is shown in Figure 19. In step 301, the consumer selects whether to sell or recycle the electronic device. The consumer looks at a list on the kiosk screen to see if the electronic device is available for sale / refurbishment. The consumer activates an on-screen menu system and either directly enters the phone model or browses a series of menus to determine if the electronic device is available for sale or can only be recycled. In decision block 302, it is determined that the electronic device can only be recycled. If the electronic device can only be recycled (i.e., it is not on the list of electronic devices available for resale), the consumer can insert the electronic device into a receptacle in step 303, which then drops into the bin 112 for recycling.
[0034] If the electronic device is refurbished / resaleable, the consumer is invited to proceed with the system's test / evaluation operations. In step 304, the system determines the correct connector for connection to the electronic device. Connectivity options include but are not limited to cable, standard or proprietary connector, hard dock, removable or external physical memory for reading or other wireless methods (e.g., WiFi, Bluetooth, RFID, NFC). In step 305, the electronic device is connected and inserted into the inspection area 106. If this is done correctly, some notification is given to the consumer (e.g., a green light) and the system proceeds to step 306. In step 306, the electronic device is tested using diagnostics, e.g., operating through the OMSI interface. The diagnostics preferably include electrical and physical tests (e.g., testing the electronic device's battery, screen, memory, button functions and structural integrity).
[0035] Preferably, the electronic device is imaged and analysis software is used to identify scratches, cracks, wear patterns, dents, broken or missing parts, inclusion of features (e.g., lenses, buttons, connectors, badges, labels and / or branding). Identification may be done by image comparison methods or other similar methods, where a photographed image of the electronic device is normalized and compared to a reference image. Other inspection methods may be used in conjunction with visual and / or electrical testing (e.g., weighting) to determine a specific weight, and this data is used to further refine manufacturer matching and correct device model matching. In another embodiment, a photographic image is used to identify the correct manufacturer and model number / product number. Visual identification may include any combination of the following: calculation based on measurements, physical (e.g., mm, inches), pixel count, etc. Identification is based on the dimensions of the electronic device, button location / size, LCD and other physical characteristics. A single camera or multiple cameras may be used to determine height, width, depth as needed. Identification is based on OCR (Optical Character Recognition) of identifiers (e.g., carrier, brand, model, serial number, other identifiers (for phones and tablet computers)). Identification is based on bar codes. The consumer may be instructed to orient the CE on the front, back, side, and then instructed to change orientation as needed. Additionally, the consumer may be instructed to remove the CE cover(s), battery, etc. to gain access to identifiable items (e.g., alphanumeric or bar code data). Kiosk 100 provides a method to identify a device, determine its value, and reduce the likelihood of fraud using visual inspection in conjunction with electrical inspection.
[0036] In one embodiment, the kiosk 100 communicates with the carrier associated with the cell phone to collect any information that may be germane to the device (e.g., validity or authenticity, registered ownership, account status, service terms, etc.) In some cases, if the consumer's specific information does not match the registered owner information, the kiosk 100 automatically contacts the assumed owner in some manner (automated phone call, email, text message) to alert the owner of the phone of the potential transaction.
[0037] Another feature of the kiosk 100 embodiment is the ability to determine if there is personal information on the electronic device. This is determined by checking for the presence of data in certain storage registers in memory (e.g., quick key storage number) or by checking for file types (e.g., jpeg, mp3) or simply assuming that all non-default storage locations contain personal data. The consumer is given the opportunity to erase the data from the phone. One option allows the consumer to first download the data and then send it to a location specified by the consumer (e.g., email address, website). In another embodiment, a slot is provided for the consumer to insert a memory card (e.g., USB drive, memory stick). Once the memory card is inserted through this slot, the kiosk 100 uploads the data to the memory device. In yet another embodiment, the kiosk 100 provides a web location from which the user can later retrieve the data when desired. In another embodiment, the user chooses to save the data at the kiosk 100 in another electronic device purchased by the consumer or to save it at the kiosk 100's location or some other storage location. The consumer preferably selects a username and password to access the storage location provided by the system.
[0038] After the value is determined, this value is provided to the kiosk in step 307. The kiosk 100 then provides the consumer with the price or other consideration for the phone, which is typically less than the resale value. In step 311, the kiosk 100 completes any further testing and diagnostics of the electronic device, disconnects the cable from the electronic device, and prints a receipt for the consumer. A funds transfer may be authorized by the kiosk 100 by crediting the consumer's credit card or by dispensing a cash account or dispensing a voucher or coupon. In step 312, the kiosk 100 updates its inventory database and sends the updated information over the communications network to the kiosk server.
[0039] One preferred method of the present invention is shown in the flow chart of FIG. 18. Method 1000 begins at block 1001. A mobile phone 150 is placed in the inspection area 106 of the kiosk 100. The inspection area has a light. The electronic device is imaged in a deactivated mode. At block 1002, the display screen of the electronic device is imaged. With the electronic device in an active mode and the light in the inspection area 106 turned off, an analysis image of the electronic device is obtained. At block 1003, the display screen of the electronic device 150 is imaged again, but with the light in the inspection area 106 turned on, and a first image of the electronic device is obtained. The mobile phone 150 must have its camera function in camera mode. At block 1004, the first image of the electronic device is subtracted from the analysis image to generate a subtraction image of the electronic device. At block 1005, the subtraction image is compared to the image of the electronic device in the deactivated mode to determine if there are defects in the display screen of the electronic device, and an analyzed electronic device is defined. At block 1006, the mobile phone value is determined as described in more detail below.
[0040] Preferably, the kiosk 100 of the method includes a housing 105. The housing 105 includes a user interface on an exterior surface of the housing for input of information by a user and includes an upper dome and a lower dome. The upper dome and the lower dome include a plurality of mirrors. The kiosk 100 further includes an upper chamber camera, a lower chamber camera, and a transparent surface. The kiosk 100 further includes a processor 160. The processor 160 is disposed within the housing and in communication with the at least one camera. The processor 160 is configured to identify a brand and model number of the electronic device based on at least one of the information from the user and the image from the at least one camera. The processor 160 is configured to determine a value of a monetary consideration for the electronic device.
[0041] The upper and lower domes preferably include walls made of mirrors. The dome-shaped device further includes a transparent surface and at least one camera. The camera can obtain multiple views of the electronic device placed in the dome-shaped device. The upper dome preferably includes an upper chamber camera. The lower dome preferably includes a lower chamber camera. Preferably, the combination of the upper and lower dome cameras, respectively, and the multiple mirrors allows an image of the device to be placed on the transparent surface. Preferably, the combination of the upper and lower dome cameras, respectively, and the multiple mirrors allows a 360 degree electronic device to be placed on the transparent surface. Preferably, the upper and lower dome cameras, respectively, are movable.
[0042] Another method of the present invention is illustrated in the flow chart of FIG. 20. Method 2000 begins at block 2001 where an electronic device is placed within an inspection area of kiosk 100. Inspection area 106 includes a camera. At block 2002, a portion of the electronic device is imaged, including a portion of the electronic device's periphery, resulting in a periphery image. At block 2003, the periphery image of the electronic device obtained by at least one camera located within the inspection area is inspected. At block 2004, it is determined whether a display screen of the electronic device is defective, defining an analyzed electronic device. At block 2005, a value of the analyzed electronic device is determined.
[0043] The information from the peripheral image preferably includes the model name and the location of the LED aperture. Additionally, the processor 160 is configured to automatically adjust the peripheral edge to a rectangular shape to compensate for screen damage that causes image distortion due to missing a certain portion of the screen. The peripheral image includes a 360-degree image. The information from the peripheral image includes the location of the USB port, the location of the volume control button, the location of the camera button, and the location of the power on / off button. The information from the peripheral image also includes the location of the camera lens and the logo of the electronic device.
[0044] Preferably, visual inspection and recognition software is used by the kiosk 100 to analyze the mobile phone 150. In one preferred method, a recognition algorithm is applied to the particular make and model of mobile phone 150. The visual inspection and recognition software determines the boundaries of the mobile phone 150 being inspected to determine the exterior dimensions of the mobile phone 150. The exterior dimensions are used to determine a subset of possible mobile phones from a master database of mobile phones stored in the memory 161 of the kiosk 100 or available online to the kiosk 100 using external communications. The visual inspection and recognition software then preferably uses a set of secondary and tertiary features to further distinguish the mobile phone 150. These secondary and tertiary features may include display screen placement and size, keyboard placement and size, unique buttons, port placement, and other distinguishing features. After determining the correct make and model of the mobile phone, the visual inspection and recognition software subtracts an image of the mobile phone 150 from an image of a complete mobile phone of the same make and model. The result of the subtraction is preferably a quantifiable number of pixels that are inspected for broken or missing parts, screen cracks, and categories of low, medium or high levels of wear.
[0045] Alternatively, visual inspection is performed using neural network pattern recognition techniques to identify the mobile phone 150. Filter algorithms are then used to determine defects (e.g., screen cracks). Moreover, a person skilled in the relevant art will recognize that other visual inspection techniques may be used without departing from the scope and spirit of the present invention.
[0046] Additionally, the visual inspection optionally includes obtaining a thermal signature for the mobile phone 150. One preferred method for obtaining a thermal signature of the mobile phone 150 is to raster a laser over the mobile phone to characterize the decay heat profile of the submitted mobile phone 150. This decay heat profile is then compared to the decay heat profiles of a complete sample of identical mobile phones 150. The decay heat profile indicates wear on the exterior surface of the mobile phone 150. This wear is used to calculate the monetary value of the mobile phone 150.
[0047] Yet another method of the present invention includes placing an electronic device within an inspection area of a recycling kiosk 100, powering the electronic device, and displaying a known image on an LCD screen of the electronic device. The known image on the LCD screen of the electronic device is compared to a stored copy of the known image stored on the recycling kiosk to determine defects in the LCD screen of the electronic device and define an analyzed electronic device. The method further includes determining a value of the analyzed electronic device.
[0048] In one embodiment of the method, the known image is a start-up image for a carrier of the electronic device. In another embodiment, the known image is an image of a national park. The method may further include performing an electrical analysis of the electronic device.
[0049] The method preferably images the electronic device when it is placed in the kiosk, whatever state the electronic device is in. The method then compares the image to a training database of all different types of electronic devices that have been previously trained (all training images preferably with the screens off).
[0050] The method preferably images more than just the display screen of the electronic device, i.e. the method preferably images everything on the electronic device (e.g. any illuminated keyboard on a Blackberry).
[0051] The method preferably subtracts the analysis image from the first image. The method also preferably multiplies the analysis image by a multiplier to take into account changes in screen luminance. For example, if the screen luminance did not change between the two images, the multiplier is 1. If the screen luminance at the analysis image was 1 / 2 the luminance of the "first image" at the analysis image, the analysis image is multiplied by 2. (Basically the brightness compensation factor is there to account for the screen having an automatic brightness that changes when the kiosk's dome light is on / off.) This image is a "composite" image because it is partially composited by subtraction. Subtracted image is used synonymously with composite image.
[0052] The method preferably compares the subtracted image with all the different training images of the electronic device to first identify the electronic device, and then analyzes the defects after the electronic device is identified. However, the main purpose of the subtraction is to generate an image of the appearance of the electronic device when the screen is off, since it is preferred to first identify the electronic device by comparing such an appearance image with the training images of the electronic device when the screen is off. Then, after the electronic device is identified (or after the expected appearance is identified, which may be a set of 5 or 10 similar electronic devices), the defects are analyzed.
[0053] Preferably, an image of the electronic device in the kiosk is generated and compared to the training data to identify the electronic device and determine the state of all of its characteristics.
[0054] In another embodiment, there are two steps in the process: 1) obtain an outline image to determine the location of the electronic device within the kiosk and the size of the electronic device (e.g., side view, size of the side of the electronic device); 2) obtain a fully lit image and "map the texture" of the electronic device onto the outline image to determine not only the outline but also the actual appearance of the electronic device when surrounded by light.
[0055] In one embodiment, the mirror is only a small portion of the chamber wall. Most of the wall is preferably white plastic / painted to diffuse the light to produce even lighting and minimize specular reflections.
[0056] In the preferred kiosk, five of the six sides of the electronic device are shown. The top camera captures the front and three sides (left, top, right) of the electronic device, and the bottom camera captures the back of the electronic device. Because there are three mirrors instead of four, the top bottom portion of the electronic device (where the cable connector is located in the case of an IPHONE phone) is not visible. Therefore, both cameras combine to capture five of the six sides, and the top camera captures only four of the six sides. The location, size, shape, and color of all buttons are imaged regardless of their function. For example, an IPHONE 4S cell phone looks identical to a VERIZON IPHONE 4 cell phone (except for the SIM card slot on the side). Therefore, the kiosk 100 uses the presence of the SIM card slot to determine that the electronic device is an IPHONE 4S cell phone and not a VERIZON IPHONE 4 cell phone.
[0057] The present invention preferably extracts features from training images and stores these features in a database along with other information (eg, make and model of electronic device, screen area / location and other data).
[0058] The "periphery image" is preferably not used to detect defects in the screen. The present invention analyzes the image contour (area) to aid in device identification because the contour gives the phone's dimensions, which helps narrow down the devices in the training database to compare (only compare with other phones of similar size, as it would be pointless to compare with all small phones).
[0059] FIG. 10 is an image of the cell phone 150 with the lights on. The cell phone's display screen 153 is visible. Touch screen buttons 153a-c are visible. Physical buttons 156, 157, and 159 are visible on the periphery of the phone 150. FIG. 11 is an image of the phone of FIG. 10 with the lights off. The display screen 153 is barely visible. FIG. 12 is a subtraction result of subtracting an image of the phone 150 with the lights on from an image of the phone 150 with the lights off. FIG. 13 is an image of the phone with the display screen 153 off. FIG. 14 shows the line intensity profile of the image of FIG. 13 (solid line 1401) and an image of the phone 150 of FIG. 12 (dashed line 1402). The spike at time 211 indicates the text area in FIG. 12.
[0060] Another aspect of the present invention is the detection of fake electronic devices. As shown in FIG. 15, the image of a lit fraudulent cell phone 150 (when the light in the inspection area is turned on) shows a photo printed on cardboard and placed under the display screen glass 153 rather than the LCD. The image has a lot of light and color variations on the screen area. However, there is no light emission from the cell phone. When the light in the inspection area is turned off, the display screen of the cell phone 150 displays nothing as shown in FIG. 16. Therefore, the kiosk 150 of the present invention can automatically detect non-authentic (fake) electronic devices. Furthermore, images of fake phones are stored in a database for training because such images are likely to be used multiple times. Also, fake phones do not contain electronic components in the housing. Thus, the mass of fake phones is different from genuine phones, so if the kiosk 100 is equipped with a weight scale, another means for detecting fake phones is possible.
[0061] Another aspect of the present invention is the detection of cracks in phone screens. As shown in Figure 17, an image of a genuine cell phone 150 has a crack in the display screen 153. By performing a color entropy metric, the present invention is able to distinguish between an actual crack in the display screen glass and an image that contains multiple color variations, since a crack in the glass would not produce multiple different colors.
Claims
1. A method for analysis of an electronic device having a display screen, the electronic device being placed within an inspection area of a kiosk, the kiosk comprising an imaging component and a processor, the method comprising: the imaging component generating a first image by imaging the electronic device while a light source in the inspection area is on and the electronic device is in an active mode, the active mode being a mode in which the display screen of the electronic device is illuminated; generating a second image by the imaging component imaging the electronic device while the light source in the inspection area is off and the electronic device is in the active mode; generating a composite image by subtracting the second image from the first image; the processor comparing the composite image to a plurality of training images of an electronic device to identify the electronic device and determine whether the electronic device is defective. A method comprising:
2. The method of claim 1, wherein the electronic device is a mobile phone, a tablet computer or an e-reader.
3. The method of claim 1, further comprising the processor increasing the brightness of the second image.
4. The processor determining that the display screen has a plurality of colors but does not emit light; the processor determining that the electronic device is not authentic; The method of claim 1 further comprising:
5. The method of claim 1, further comprising the processor determining a value of monetary compensation for the electronic device.
6. The method of claim 5, wherein the kiosk further comprises a cash dispenser, the method further comprising the cash dispenser dispensing cash to a user of the kiosk in exchange for the electronic device.
7. The method of claim 5, wherein determining a value of the monetary consideration for the electronic device includes the processor determining a value of the monetary consideration based at least in part on an identity of the electronic device.
8. The method of claim 5, wherein the electronic device is automatically binned after determining the value of the monetary consideration for the electronic device.
9. The method of claim 1, wherein comparing the plurality of training images with the synthetic image includes the processor comparing the plurality of training images with the synthetic image to authenticate that the electronic device is authentic.
10. The method of claim 1, wherein the electronic device is received on a transparent surface within the inspection area of the kiosk.
11. The method of claim 1, wherein the imaging component is a camera, the electronic device is supported on a transparent plate in the inspection area, and imaging the electronic device while the light source is on includes the camera imaging the electronic device via a first camera position above the transparent plate or via a second camera position below the transparent plate.
12. The method of claim 1, wherein the imaging component is a camera, the electronic device is supported on a transparent plate in the inspection area, and imaging the electronic device while the light source is off includes the camera imaging the electronic device via a first camera position above the transparent plate or via a second camera position below the transparent plate.
13. The method of claim 12, further comprising: electrically testing the electronic device; obtaining a price for the electronic device, the price being based at least in part on the electrical test, the identity, and whether the electronic device is defective; The method of claim 1 further comprising:
14. The method of claim 1, further comprising: prior to imaging the electronic device, the processor causing the electronic device to move into the inspection area.
15. The method of claim 1, further comprising: prior to imaging the electronic device, the processor causing the electronic device to be positioned between a pair of cameras positioned within the kiosk.