Image Processing Device for Droplet Charge Timing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing fine particle sorting devices, such as flow cytometers, face challenges in accurately determining the break-off position and delay time for electric charge application to droplets, leading to unreliable and unstable sorting processes that require user expertise.

Innovation Solution

An image processing device and method that calculates the drop delay time by correlating positional information of fine particles with light source lighting delay times, allowing for precise timing of electric charge application to droplets using a microchip-type flow cytometer with a charging unit, detection unit, droplet camera, and image processing unit.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the break-off position and delay time are determined by conventional methods, then the sorting process can be performed, but the accuracy and reliability of electric charge application timing deteriorates

Engineering Contradiction:
Improvebreak-off position detection accuracyVSAvoidsorting process reliability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent replaces conventional mechanical/optical detection methods with image processing technology. A camera captures images of the fluid stream and droplet formation, and image processing algorithms automatically determine the break-off position and calculate delay time. This substitution of mechanical detection with optical imaging and computational processing significantly improves measurement precision and sorting reliability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an image processing unit as an intermediary between the droplet formation process and the charging control system. This intermediary captures visual information of the fluid stream, processes the images to determine break-off positions, and provides accurate timing information to the charging unit, thereby improving the overall system reliability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If user visual check is used to determine correct charge application timing, then sorting can be performed, but the ease of operation deteriorates due to requirement of expert skills

Engineering Contradiction:
Improvesorting operation easeVSAvoidsorting process stability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system performs self-adjustment through automatic image processing. The image processing unit automatically captures images, determines break-off positions, calculates delay times, and adjusts charging timing without requiring user intervention or expert visual assessment. This automation eliminates the need for expert skills while maintaining high reliability and stability in sorting operations.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent implements a feedback loop where the image processing unit continuously monitors droplet formation, determines break-off positions, and adjusts charging timing accordingly. This closed-loop feedback system automatically optimizes the sorting process, making it easy to operate while maintaining high reliability without requiring user expertise.

Inventive Principle:
Principle #23Feedback

3Manufacturing precision

If conventional timing methods are used for electric charge application, then the device complexity remains low, but the manufacturing precision of droplet sorting deteriorates

Engineering Contradiction:
Improvedroplet sorting precisionVSAvoidimage processing system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The image processing unit serves multiple functions: capturing images of the fluid stream, determining break-off positions, calculating delay times, and providing timing information to the charging system. This multi-functional approach improves droplet sorting precision while minimizing the increase in device complexity by using a single integrated unit rather than multiple separate components.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate and reliable electric charge application to droplets, improving the sorting process by determining the optimal drop delay time through statistical processing of luminance information and droplet imaging, enhancing sorting precision and stability.

Implementation Method 1

vibration is applied to the orifice so as to form a droplet from the fluid stream

Methodology Applied
Scientific EffectVibration: Vibration

Implementation Method 2

electric charge is applied to the droplet

Methodology Applied
Scientific EffectElectric charge: Electrostatics

Implementation Method 3

a moving direction of the droplet including the cell discharged from the orifice is electrically controlled

Methodology Applied
Scientific EffectElectrical force: Lorentz Force

Data Source

PatentEP3343200B1Image processing device, microparticle separation device, and image processing method
Publication Date: 2021.12.15 SONY GROUP CORP
  • EP3343200B1 patent drawingFigure 1
  • EP3343200B1 patent drawingFigure 2(A)~2(B)
  • EP3343200B1 patent drawingFigure 3(A)~3(C)

AI summary

Provided are: an image processing device; a fine particle sorting device; and an image processing method, in which electric charge can be easily and accurately applied to a droplet. An image processing device including: a control unit adapted to set a light source lighting delay time to control a light source, the light source lighting delay time indicating a time from a time point when a fine particle in fluid is detected by a detection unit until a time point when the light source is turned on for the fine particle included in a droplet formed from the fluid; a processing unit adapted to identify positional information of the fine particle on the basis of an image of the fine particle acquired in accordance with lighting of the light source during the set light source lighting delay time; and a recording unit adapted to record, in a correlated manner, the positional information identified in the processing unit and the light source lighting delay time. The processing unit determines, as a drop delay time, a light source lighting delay time correlated to target positional information that is predetermined positional information, and the drop delay time indicates a time from the time point when the fine particle is detected by the detection unit until the droplet is formed from the fluid containing the fine particle.