Jump to content

Machine learning: Difference between revisions

From Nanopore Wiki
Add structured content for machine learning and site discoverability
 
Use topic-specific Wikimedia Commons illustrations
 
(2 intermediate revisions by the same user not shown)
Line 1: Line 1:
<translate>
<translate>
<!--T:1-->
= Machine learning =
= Machine learning =
<!--T:1-->
[[File:Patch_clamp_schematic_1.png|thumb|right|320px|Patch-clamp and single-channel electrophysiology concepts are relevant to nanopore measurements. Source: Wikimedia Commons, CC BY-SA 4.0.]]
[[File:Detection pics scipy signal find peaks.svg|thumb|right|320px|Signal processing and peak detection are useful analogies for nanopore event detection. Source: Wikimedia Commons, CC BY-SA 4.0.]]
'''Machine learning''' in nanopore research refers to computational methods that learn patterns from raw electrical signals, basecalled reads, alignments, and quality-control data. It is important because nanopore measurements are long, noisy, context-dependent, and often produced in real time.
'''Machine learning''' in nanopore research refers to computational methods that learn patterns from raw electrical signals, basecalled reads, alignments, and quality-control data. It is important because nanopore measurements are long, noisy, context-dependent, and often produced in real time.


<!--T:2-->
== Why it matters ==
== Why it matters ==
<!--T:2-->
Nanopore devices measure changes in ionic current or related signals as molecules pass through or interact with a pore. The same molecule can produce different signal traces depending on pore chemistry, motor speed, temperature, sample preparation, electronics, and neighboring bases. Machine learning helps connect these variable signals to biological or chemical interpretation.
Nanopore devices measure changes in ionic current or related signals as molecules pass through or interact with a pore. The same molecule can produce different signal traces depending on pore chemistry, motor speed, temperature, sample preparation, electronics, and neighboring bases. Machine learning helps connect these variable signals to biological or chemical interpretation.


Line 18: Line 18:
* '''Variant and consensus analysis''' - combining long reads and model-based error profiles.
* '''Variant and consensus analysis''' - combining long reads and model-based error profiles.


<!--T:4-->
== Representative tasks ==
== Representative tasks ==
<!--T:4-->
{| class="wikitable"
{| class="wikitable"
! Task !! Typical input !! Example output !! Why it is difficult
! Task !! Typical input !! Example output !! Why it is difficult
Line 34: Line 34:
|}
|}


<!--T:5-->
== Notable examples ==
== Notable examples ==
<!--T:5-->
* '''DeepNano''' used recurrent neural networks for early open-source MinION basecalling and showed how learned models could reduce nanopore read errors.
* '''DeepNano''' used recurrent neural networks for early open-source MinION basecalling and showed how learned models could reduce nanopore read errors.
* '''MinCall''' explored end-to-end convolutional neural-network basecalling with CTC-style sequence modeling.
* '''MinCall''' explored end-to-end convolutional neural-network basecalling with CTC-style sequence modeling.
Line 44: Line 44:
* '''Adaptive sampling tools''' use rapid signal or sequence analysis to enrich targets or deplete unwanted molecules during a run.
* '''Adaptive sampling tools''' use rapid signal or sequence analysis to enrich targets or deplete unwanted molecules during a run.


<!--T:6-->
== Good practice ==
== Good practice ==
<!--T:6-->
Machine-learning results should be interpreted with experimental context. A model trained on one pore chemistry, kit, organism, base modification, or software version may not transfer perfectly to another. Reports should state the model version, chemistry, training or calibration data, reference genome, thresholds, and validation method where possible.
Machine-learning results should be interpreted with experimental context. A model trained on one pore chemistry, kit, organism, base modification, or software version may not transfer perfectly to another. Reports should state the model version, chemistry, training or calibration data, reference genome, thresholds, and validation method where possible.


<!--T:7-->
== Common pitfalls ==
== Common pitfalls ==
<!--T:7-->
* Treating model output as ground truth without orthogonal validation.
* Treating model output as ground truth without orthogonal validation.
* Comparing tools across different pore chemistries or basecaller versions without controls.
* Comparing tools across different pore chemistries or basecaller versions without controls.
Line 56: Line 56:
* Using proprietary model names without recording software versions and parameters.
* Using proprietary model names without recording software versions and parameters.


<!--T:8-->
== Selected papers and resources ==
== Selected papers and resources ==
<!--T:8-->
* Boza V, Brejova B, Vinar T. [https://arxiv.org/abs/1603.09195 DeepNano: Deep Recurrent Neural Networks for Base Calling in MinION Nanopore Reads]. 2016.
* Boza V, Brejova B, Vinar T. [https://arxiv.org/abs/1603.09195 DeepNano: Deep Recurrent Neural Networks for Base Calling in MinION Nanopore Reads]. 2016.
* Wick RR, Judd LM, Holt KE. [https://genomebiology.biomedcentral.com/articles/10.1186/s13059-019-1727-y Performance of neural network basecalling tools for Oxford Nanopore sequencing]. ''Genome Biology''. 2019.
* Wick RR, Judd LM, Holt KE. [https://genomebiology.biomedcentral.com/articles/10.1186/s13059-019-1727-y Performance of neural network basecalling tools for Oxford Nanopore sequencing]. ''Genome Biology''. 2019.
Line 67: Line 67:
* Oxford Nanopore Technologies. [https://github.com/nanoporetech/dorado Dorado basecaller and related tools].
* Oxford Nanopore Technologies. [https://github.com/nanoporetech/dorado Dorado basecaller and related tools].


<!--T:9-->
== Related pages ==
== Related pages ==
<!--T:9-->
* [[Nanopore sequencing]]
* [[Nanopore sequencing]]
* [[Bioinformatics]]
* [[Bioinformatics]]

Latest revision as of 16:47, 2 July 2026

Machine learning

Patch-clamp and single-channel electrophysiology concepts are relevant to nanopore measurements. Source: Wikimedia Commons, CC BY-SA 4.0.

Machine learning in nanopore research refers to computational methods that learn patterns from raw electrical signals, basecalled reads, alignments, and quality-control data. It is important because nanopore measurements are long, noisy, context-dependent, and often produced in real time.

Why it matters

Nanopore devices measure changes in ionic current or related signals as molecules pass through or interact with a pore. The same molecule can produce different signal traces depending on pore chemistry, motor speed, temperature, sample preparation, electronics, and neighboring bases. Machine learning helps connect these variable signals to biological or chemical interpretation.

Key uses include:

  • Basecalling - converting raw signal into DNA or RNA sequence.
  • Modified-base detection - identifying methylation and other nucleotide modifications directly from signal.
  • Signal segmentation - detecting events, stalls, adapters, pores, and read boundaries.
  • Quality control - predicting read reliability, pore health, contamination, and run performance.
  • Adaptive sampling - deciding in real time whether to continue sequencing a molecule.
  • Variant and consensus analysis - combining long reads and model-based error profiles.

Representative tasks

Task Typical input Example output Why it is difficult
Basecalling Raw current signal or POD5/FAST5 signal FASTQ reads with quality scores Signal speed varies and neighboring bases affect current levels.
Modified-base detection Signal plus reference alignment 5mC, 5hmC, m6A or other modification calls Modified and unmodified bases can have subtle, context-dependent signal differences.
Adaptive sampling Streaming signal or early basecalled sequence Accept/reject decision for a molecule The decision must be fast enough to act during sequencing.
Event detection Time-series current trace Candidate translocation or binding events Noise, drift, pore variation, and short events can obscure boundaries.
Run monitoring Sequencing summary, read length, pore state, quality metrics Alerts and quality summaries Metrics change over time and vary by protocol.

Notable examples

  • DeepNano used recurrent neural networks for early open-source MinION basecalling and showed how learned models could reduce nanopore read errors.
  • MinCall explored end-to-end convolutional neural-network basecalling with CTC-style sequence modeling.
  • Bonito, Guppy, and Dorado represent modern neural-network basecalling directions used around Oxford Nanopore workflows.
  • Dynamic-pooling basecallers such as Heron and Osprey address variable molecule translocation speed by adapting pooling behavior in neural networks.
  • Hardware-aware basecalling projects such as RUBICON study how to make neural basecallers faster and less memory-intensive.
  • Modified-base tools such as Nanopolish-style signal models and newer neural approaches support direct methylation or modification analysis without bisulfite conversion.
  • Adaptive sampling tools use rapid signal or sequence analysis to enrich targets or deplete unwanted molecules during a run.

Good practice

Machine-learning results should be interpreted with experimental context. A model trained on one pore chemistry, kit, organism, base modification, or software version may not transfer perfectly to another. Reports should state the model version, chemistry, training or calibration data, reference genome, thresholds, and validation method where possible.

Common pitfalls

  • Treating model output as ground truth without orthogonal validation.
  • Comparing tools across different pore chemistries or basecaller versions without controls.
  • Ignoring calibration, class imbalance, and false-positive rates in modified-base analysis.
  • Reporting only read-level accuracy while ignoring consensus accuracy or downstream task accuracy.
  • Using proprietary model names without recording software versions and parameters.

Selected papers and resources