DNase-Seq on Genomics x AI

[ENCODE GRAMMAR] Quickstart: Accessing and using the ENCODE GRAMMAR collection

Tue, 04 Aug 2026 00:00:00 +0000

Summary

ENCODE GRAMMAR (Genomic Regulatory Atlas of sequence Models, Motifs, Annotations and Rules) is a collection of 3,865 experiment-specific deep learning model sets and derived sequence annotations that connect the ENCODE project’s human gene regulation maps from extensive biochemical profiling experiments to the underlying DNA sequence features that drive regulatory activity.

This five-minute quickstart guide shows how to find an ENCODE GRAMMAR model-set and its associated annotation and load its most commonly used outputs into an interactive genome browser. By following the steps below, you will create a browser session displaying an experimentally observed regulatory profile, the corresponding model-predicted profile, and a base-resolution sequence-contribution map.

Contributions: (Author order does not represent relative contribution)

Vivekanandan Ramalingam¹ (vir@stanford.edu): BPNet model optimization and training, data uploads, general analysis
Chang M. Yun¹ (chang.m.yun@stanford.edu): ChromBPNet model training, MotifCompendium analysis
Vivian Hecht¹ (vhecht@stanford.edu): ChromBPNet model training, model resource uploads, project management
Aman Patel¹ (patelas@stanford.edu): Model resource uploads
Anusri Pampari¹ (anusri@stanford.edu): ChromBPNet model development, ChromBPNet model training, data uploads
Ziwei Chen¹ (ziwei75@stanford.edu): ReporterNet model development, ReporterNet model training, ChromBPNet model training
Kelly Cochran¹ (kcochran@stanford.edu): ProCapNet model development and training
Adam He¹ (ayhe@stanford.edu): ProCapNet user guide
Surag Nair¹ (surag@stanford.edu), Zahoor Zafrulla¹ (zahoor@stanford.edu), Alex Tseng¹ (amtseng@stanford.edu): BPNet refactoring
Avanti Shrikumar¹ (avanti@stanford.edu), Jacob Schreiber¹ (jmschr@stanford.edu), Alex Tseng¹ (amtseng@stanford.edu): TF-MoDISco methods development and optimization
Austin Wang¹ (atwang@stanford.edu): FiNeMo methods development
Salil Deshpande¹ (salil512@stanford.edu), Chang M. Yun¹ (chang.m.yun@stanford.edu): MotifCompendium methods development
Abhimanyu Banerjee¹ (manyu@stanford.edu), Georgi K. Marinov¹ (marinovg@stanford.edu): Zinc finger transcription factor analysis
Chang M. Yun¹ (chang.m.yun@stanford.edu), Vivian Hecht¹ (vhecht@stanford.edu), Vivekanandan Ramalingam¹ (vir@stanford.edu): Blog posts
Anshul Kundaje¹* (akundaje@stanford.edu): Conceptualization, Project management, Mentoring, Funding, Blog post editing

¹Stanford University, *Correspondence.

This is the second post in a series on ENCODE GRAMMAR. The series will cover:

ENCODE GRAMMAR: The ENCODE deep learning model resource for decoding the DNA sequence logic of genomic regulatory elements

Accessing and using the ENCODE GRAMMAR collection: A quickstart guide (this post)

Interpreting regulatory DNA with deep learning models

The transcription factor binding GRAMMAR resource

The chromatin accessibility GRAMMAR resource

Predicting the effects of noncoding genetic variants

MotifCompendium - a unified lexicon of regulatory sequence motifs

Contrasting regulatory sequence codes across assays and cell types

Building a production-scale model atlas in an academic setting

Quick-start guide (5 min)

ENCODE GRAMMAR transforms individual ENCODE experiments into experiment-specific BPNet-family model sets together with predicted regulatory profiles, sequence-contribution maps, predictive motifs, motif instances, and variant-effect predictions. Readers who are new to the resource may wish to begin with the ENCODE GRAMMAR overview, which explains the biological motivation, model families, interpretation workflow, and complete collection of released products.

Below, we explain how to navigate an ENCODE GRAMMAR model-set annotation page and load several commonly used model outputs into the WashU Epigenome Browser. Visualizing these tracks is a useful first step before designing larger-scale quantitative analyses.

We use the example of a ChromBPNet model set generated from an ATAC-seq experiment in K562 cells (ENCSR893SUD).

Step 1: Find the model-set annotation page

Open the ChromBPNet model-set annotation for K562 ATAC-seq: https://www.encodeproject.org/annotations/ENCSR893SUD/.

Model-set annotations associated with an experiment can also be found from the corresponding experiment summary page.

A searchable list of all ENCODE annotations is available at https://www.encodeproject.org/annotations/.

Step 2: Find the files of interest

Scroll to the middle of the annotation page and select the File details tab to browse the available files.

For an initial exploration of a ChromBPNet model set, we recommend viewing three complementary tracks:

the normalized observed signal profile, representing the experimentally measured chromatin-accessibility profile;
the normalized predicted signal profile, representing the regulatory profile predicted by ChromBPNet from DNA sequence; and
the counts sequence-contribution scores, estimating how much each DNA base contributes to the model’s prediction of total accessibility.

The following steps require the URLs of these bigWig files. Right-click the download icon beside a file and select Copy link address. The links for this example are provided here:

Normalized observed signal profile: https://www.encodeproject.org/files/ENCFF880ZUI/@@download/ENCFF880ZUI.bigWig
Normalized predicted signal profile: https://www.encodeproject.org/files/ENCFF296ICJ/@@download/ENCFF296ICJ.bigWig
Counts sequence contribution scores: https://www.encodeproject.org/files/ENCFF407GCO/@@download/ENCFF407GCO.bigWig

This quickstart focuses on these three tracks. Additional ENCODE GRAMMAR products, including predictive motif-instance annotations, can be accessed through the ENCODE Portal and the UCSC Track Hub linked below.

For descriptions of the complete collection of files and model-derived products, see the ENCODE GRAMMAR overview and the ENCODE 4 preprint.

Step 3: Load the bigwigs into the WashU genome browser

Navigate to the WashU Epigenome Browser. On the home page, find the Human section and select hg38 to open a new browser session.

In the new browser session, select the Tracks icon at the top of the page and then choose Remote Tracks from the dropdown menu.

A window for adding remote tracks will appear:

First, add the normalized observed signal profile and normalized predicted signal profile:

Copy and paste the first URL from Step 2.
Add an informative label, such as Observed accessibility.
Click Submit.
Click Add another track and repeat the process for the predicted profile, using a label such as ChromBPNet predicted accessibility.

For the third bigWig—the counts sequence-contribution scores—change the track type to Dynseq. Select the Track type menu and choose Dynseq (dynamic sequence) from the list.

Dynseq displays each nucleotide as a letter whose height and direction reflect its contribution score. Positive scores indicate bases that increase the model prediction relative to the reference, whereas negative scores indicate bases that decrease it. The nucleotide letters appear only after zooming in sufficiently. Clusters of bases with large contribution scores often correspond to predictive regulatory sequence features, including transcription-factor motif instances.

Add an informative label, such as Counts sequence-contribution map, and submit the track.

The completed browser session should resemble the example below, with the experimentally observed profile, model-predicted profile, and sequence-contribution map aligned at the same genomic locus:

For more information about configuring tracks, navigating loci, and sharing sessions, see the WashU Epigenome Browser documentation.

How else can I use the resources?

All ENCODE data, model sets, and model-derived sequence annotations are openly available through the ENCODE Portal. The complete ENCODE GRAMMAR resource contains 3,865 experiment-specific model sets spanning TF binding, chromatin accessibility, transcription initiation, and high-throughput reporter activity.

Additional access points include:

Model-sets and sequence annotations: Browse released BPNet model sets, ChromBPNet model sets, ProCapNet model sets, and ReporterNet model sets on the ENCODE Portal.
HuggingFace model zoo: Download ENCODE GRAMMAR models from Hugging Face.
Predictions and sequence annotations: Explore model predictions, sequence-contribution maps, and predictive motif instances through the UCSC Track Hub.
Unified motif lexicon: Access the ENCODE Motif Compendium, which organizes related predictive motifs discovered across all ENCODE GRAMMAR models.
Software: Train and interpret new models using the open-source BPNet, ChromBPNet, and ProCapNet repositories.
User guide: We are developing an interactive guide to help users navigate and interpret the resource (work in progress).
Overview and publications: Read the ENCODE GRAMMAR overview, ENCODE 4 preprint, the BPNet paper, ChromBPNet preprint and ProCapNet preprint for additional detail.

This quickstart covers only one way to explore the resource. Future (weekly) posts in this series will describe how to interpret sequence-contribution maps, compare predictive motifs across cellular contexts, and use the models to estimate the molecular effects of noncoding genetic variants.

References

The ENCODE Project Consortium et al. The Encyclopedia of DNA Elements. bioRxiv 2026.07.06.731365 (2026) (https://doi.org/10.64898/2026.07.06.731365)
Yun, C. M. et al. A unified lexicon of predictive DNA sequence motifs from ENCODE transcription factor binding and chromatin accessibility assays. (2025) doi:10.5281/zenodo.17179111. (https://doi.org/10.5281/zenodo.17179111)
Avsec, Ž. et al. Base-resolution models of transcription-factor binding reveal soft motif syntax. Nat Genet 53, 354—366 (2021). (https://doi.org/10.1038/s41588-021-00782-6)
Pampari, A. et al. ChromBPNet: bias factorized, base-resolution deep learning models of chromatin accessibility reveal cis-regulatory sequence syntax, transcription factor footprints and regulatory variants. bioRxiv 2024.12.25.630221 (2024). (https://doi.org/10.1101/2024.12.25.630221)
Cochran, K. et al. Dissecting the cis-regulatory syntax of transcription initiation with deep learning. bioRxiv 2024.05.28.596138 (2024). (https://doi.org/10.1101/2024.05.28.596138)
Shrikumar, A., Greenside, P. & Kundaje, A. Learning Important Features Through Propagating Activation Differences. arXIV (2019).(https://doi.org/10.48550/arXiv.1704.02685)
Lundberg, S. M. & Lee, S.-I. A unified approach to interpreting model predictions. in Proceedings of the 31st International Conference on Neural Information Processing Systems 4768–4777 (Curran Associates Inc., Red Hook, NY, USA, 2017). (https://dl.acm.org/doi/10.5555/3295222.3295230)
Shrikumar, A. et al. Technical Note on Transcription Factor Motif Discovery from Importance Scores (TF-MoDISco) version 0.5.6.5. arXiv (2020) (https://doi.org/10.48550/arXiv.1811.00416).

ENCODE GRAMMAR: A deep learning model resource for decoding the DNA sequence logic of regulatory elements in the human genome

Tue, 04 Aug 2026 00:00:00 +0000

Summary

Over two decades, the Encyclopedia of DNA Elements (ENCODE) Consortium has used diverse functional genomics experiments to map millions of regions in the human and mouse genomes that help control when, where, and how strongly genes are turned on. These maps characterize the biochemical properties and activity of regulatory DNA elements across thousands of cell types and tissues. However, they do not fully explain how this activity is encoded in the DNA sequence itself: which individual DNA letters are important, how combinations and arrangements of letters cause a region to behave differently across cell types, or how a genetic variant might alter its activity.

To help answer these questions, we developed a family of deep learning models that use DNA sequences as inputs to predict associated genome-wide biochemical activity measured by diverse experiments. We also developed a framework of model interpretation methods, allowing us to identify the sequence features and regulatory rules that drive model predictions.

Today, we release GRAMMAR (Genomic Regulatory Atlas of sequence Models, Motifs, Annotations and Rules), a collection of 3,865 experiment-specific model sets across the ENCODE data compendium spanning several layers of gene regulation, including the binding of regulatory proteins to DNA, chromatin accessibility, transcription initiation, and regulatory activity measured using high-throughput reporter assays. For each experiment, we also release model-predicted, de-noised biochemical activity profiles at single-base resolution; predicted contributions of individual DNA bases to the activity of each regulatory element in each cellular context; recurring predictive DNA patterns (motifs) learned by the models; the genomic locations of predictive motif instances; and genome-browser tracks that make these outputs easy to visualize and explore.

Together, these resources transform thousands of ENCODE experiments into a reusable and interpretable atlas of the cell-context-specific DNA sequence rules that shape gene regulation in the human genome. In this first post of a broader series, we introduce the ENCODE GRAMMAR resource and show how predictions and sequence annotations derived from multiple models can be integrated to decode the sequence basis of regulatory element activity.

Contributions: (Author order does not represent relative contribution)

Vivekanandan Ramalingam¹ (vir@stanford.edu): BPNet model optimization and training, data uploads, general analysis
Chang M. Yun¹ (chang.m.yun@stanford.edu): ChromBPNet model training, MotifCompendium analysis
Vivian Hecht¹ (vhecht@stanford.edu): ChromBPNet model training, model resource uploads, project management
Aman Patel¹ (patelas@stanford.edu): Model resource uploads
Anusri Pampari¹ (anusri@stanford.edu): ChromBPNet model development, ChromBPNet model training, data uploads
Ziwei Chen¹ (ziwei75@stanford.edu): ReporterNet model development, ReporterNet model training, ChromBPNet model training
Kelly Cochran¹ (kcochran@stanford.edu): ProCapNet model development and training
Adam He¹ (ayhe@stanford.edu): ProCapNet user guide
Surag Nair¹ (surag@stanford.edu), Zahoor Zafrulla¹ (zahoor@stanford.edu), Alex Tseng¹ (amtseng@stanford.edu): BPNet refactoring
Avanti Shrikumar¹ (avanti@stanford.edu), Jacob Schreiber¹ (jmschr@stanford.edu), Alex Tseng¹ (amtseng@stanford.edu): TF-MoDISco methods development and optimization
Austin Wang¹ (atwang@stanford.edu): FiNeMo methods development
Salil Deshpande¹ (salil512@stanford.edu), Chang M. Yun¹ (chang.m.yun@stanford.edu): MotifCompendium methods development
Abhimanyu Banerjee¹ (manyu@stanford.edu), Georgi K. Marinov¹ (marinovg@stanford.edu): Zinc finger transcription factor analysis
Chang M. Yun¹ (chang.m.yun@stanford.edu), Vivian Hecht¹ (vhecht@stanford.edu), Vivekanandan Ramalingam¹ (vir@stanford.edu): Blog posts
Anshul Kundaje¹* (akundaje@stanford.edu): Conceptualization, Project management, Mentoring, Funding, Blog post editing

¹Stanford University, *Correspondence.

This is the first post in a series on ENCODE GRAMMAR. The series will cover:

ENCODE GRAMMAR: The ENCODE deep learning model resource for decoding the DNA sequence logic of genomic regulatory elements (this post)

Accessing and using the ENCODE GRAMMAR collection: A quickstart guide

Interpreting regulatory DNA with deep learning models

The transcription factor binding GRAMMAR resource

The chromatin accessibility GRAMMAR resource

Predicting the effects of noncoding genetic variants

MotifCompendium - a unified lexicon of regulatory sequence motifs

Contrasting regulatory sequence codes across assays and cell types

Building a production-scale model atlas in an academic setting

The genome encodes a regulatory control system

The human genome is the complete set of instructions encoded in DNA and carried by nearly every cell in the body. It contains about 3.2 billion DNA base pairs, built from four nucleotide bases represented by the letters A, C, G, and T. Although human genomes are overwhelmingly similar, their DNA sequences differ at millions of positions across individuals. These differences, known as genetic variants, contribute to human diversity and can influence traits and disease risk.

The human body contains hundreds of distinct cell types—including neurons, liver cells, and immune cells—with very different morphology and functions. Yet nearly all cells within an individual contain essentially the same genome. How can the same DNA sequence produce such remarkable cellular diversity?

Genes are segments of DNA that contain instructions for producing RNA molecules, some of which are translated into proteins. The transcription of genes into RNA is tightly regulated: different genes are expressed at different levels, in different cell types, and at different times. These distinct patterns of gene expression allow cells with the same genome to acquire different identities and perform specialized functions. Precise regulation of gene expression is therefore essential for development, normal cellular function, and responses to the environment.

Much of this control is encoded in regulatory elements—regions of DNA that help determine when, where, and how strongly genes are expressed. Promoters are regulatory elements found at or near the sites where gene transcription begins and help recruit the molecular machinery that produces RNA. Other regulatory elements, such as distal enhancers, can act over hundreds of kilobases, boosting transcription of target gene promoters they contact through three-dimensional folding of the genome.

DNA is packaged with proteins into chromatin, which influences how accessible different regions of the genome are to the cellular machinery. Regulatory proteins called transcription factors (TFs), recognize and bind specific short DNA sequence patterns, or motifs, within regulatory elements and help increase or decrease gene expression by recruiting or blocking the machinery that carries out transcription. Chromatin accessibility and TF binding influence one another: exposed DNA is easier for regulatory proteins to reach, while some proteins can also open or reorganize chromatin.

Different cell types express different combinations of TFs and maintain different chromatin states across the genome. As a result, different cell types engage different repertoires of regulatory elements producing distinct patterns of gene expression, despite containing essentially the same genomic DNA sequence. Genetic variants within regulatory elements can alter transcription-factor binding or other regulatory activity, potentially changing gene expression in particular cellular contexts. Disruption of this regulatory system can interfere with development and cellular function and contribute to disease.

How does the same genome give rise to diverse cell types and gene-expression programs?.
(Click the figure to see detailed legend)

To understand how the genome encodes gene regulation, we therefore need to:

map the genomic locations of candidate regulatory elements;
measure their biochemical activity (e.g. transcription-factor binding and chromatin state), and associated gene expression across cell types and conditions;
determine which DNA bases within regulatory elements are important and how their combinations and arrangements control different types of biochemical activity in different cell types; and
determine how genetic variants alter biochemical activity in different cellular contexts.

ENCODE: An Encyclopedia of DNA Elements across thousands of cell types

Over the past two decades, the Encyclopedia of DNA Elements (ENCODE) Consortium has made major progress toward the first two goals. Using a broad range of genome-wide functional genomics experiments, ENCODE has mapped millions of candidate regulatory elements in the human and mouse genomes by characterizing their biochemical activity across diverse cell types, tissues, developmental stages, and conditions.

These experiments measure complementary layers of gene regulation, including where TFs bind DNA, which regions of chromatin are accessible, where transcription begins, and which genes are expressed. Together, they provide detailed maps of where regulatory activity occurs and how it differs across cellular contexts. We briefly describe some of the key experimental assays below.

Transcription factor ChIP-seq (transcription factor chromatin immunoprecipitation followed by sequencing) maps where a particular TF binds the genome in a specific cell type. Cells are treated so that proteins remain attached to the DNA they occupy, the DNA is fragmented, and an antibody is used to isolate fragments bound by the TF of interest. These fragments are sequenced on a high-throughput sequencer and mapped to the genome to identify their likely locations, which produces concentrations of reads, or peaks, at genomic regions enriched for binding by that TF. TF ChIP-seq peak regions are often statistically enriched for recurring short DNA sequence patterns, called motifs, that typically mediate the binding of the TF to DNA. However, each TF ChIP–seq experiment profiles only one TF in one cellular context. Systematically measuring the binding of the roughly 2,000 human TFs across all cell types and conditions would therefore be prohibitively laborious and expensive.

Transcription factor ChIP-seq experiments.
(Click the figure to see detailed legend)

DNase-seq and ATAC-seq experiments partly address this limitation by providing a genome-wide map of regions of accessible chromatin which are often regulatory elements occupied by combinations of TFs and other regulatory proteins. So a single accessibility experiment can highlight regulatory elements bound by many factors in a given cellular context, although it does not directly identify which proteins are bound. DNase–seq uses the enzyme DNase I to cut exposed DNA, whereas ATAC–seq uses the Tn5 transposase to insert sequencing adapters into accessible DNA. The resulting DNA fragments are sequenced and mapped to the genome. Regions containing many mapped fragments appear as peaks of chromatin accessibility. DNase I and Tn5 also have preferences for particular DNA sequences, so the observed signal profiles reflect both genuine chromatin accessibility and assay-specific sequence bias. Separating these components is especially important when interpreting the signal at single-base resolution.

DNase-seq and ATAC-seq chromatin accessibility experiments.
(Click the figure to see detailed legend)

However, TF binding and chromatin accessibility do not necessarily lead to productive downstream regulatory effects such as transcription. Additional assays are therefore needed to measure where transcription initiates and whether candidate DNA sequences can directly drive regulatory activity.

PRO-cap experiments map the precise genomic positions at which transcription initiates across the genome. It enriches for and sequences the capped 5′ ends of newly synthesized RNAs, producing base-resolution, strand-specific maps of active transcription initiation. PRO-cap can identify initiation at both gene promoters and transcribed regulatory elements, while the number of reads beginning at a site provides a measure of its relative initiation activity.

Massively parallel reporter assays (MPRAs) directly test the regulatory potential of thousands of DNA sequences in parallel. Each candidate sequence is placed alongside a reporter gene in a synthetic construct, typically together with a sequence barcode that identifies it. After the constructs are introduced into cells, regulatory activity is commonly measured by comparing the abundance of each barcode in reporter RNA with its abundance in the input DNA library. Sequences that produce more reporter RNA have greater regulatory activity in that assay and cellular context. Because the sequences are generally tested outside their native genomic locations, MPRAs measure regulatory potential in the reporter system rather than fully reproducing their endogenous functions.

Together, these assays measure complementary layers of gene regulation. TF ChIP-seq identifies where individual TFs bind; DNase-seq and ATAC-seq reveal accessible regulatory DNA; PRO-cap pinpoints sites of active transcription initiation; and MPRAs directly test whether particular DNA sequences can drive regulatory activity.

ENCODE has completed and released more than 16,000 genome-wide assays across thousands of biological samples, including cell lines, primary cells, tissues, differentiated cells, and experimentally perturbed samples from humans and mice. These data are processed using standardized pipelines and made publicly available through the ENCODE portal.

By integrating evidence from these and many other assays, ENCODE has mapped more than 5 million accessible chromatin elements in the human genome. Approximately 2.4 million of these are classified as **candidate cis-regulatory elements (cCREs)** because they are also supported by additional biochemical signatures of regulatory activity. The ENCODE consortium recently released a preprint describing the entire compendium developed over two decades including many new datasets and derived analysis products from the fourth and final phase of the project ENCODE 4.

The ENCODE data cube.
(Click the figure to see detailed legend)

Together, these experiments address two foundational goals: mapping regulatory elements throughout the genome and characterizing their biochemical activity and properties across cellular contexts. Yet these maps do not explain how DNA sequence mediates the diverse types of biochemical activity across the genome and their cell-type specificity. Important questions remain:

Which individual DNA bases and sequence motifs within a regulatory element influence different types of biochemical activity (e.g. TF binding, accessibility) in a specific cell type?
How do combinations and arrangements of these patterns determine biochemical activity?
How does the same regulatory element behave differently across cell types?
How might a genetic variant alter biochemical activity in a particular cellular context?

Answering these questions requires moving beyond mapping regulatory elements to decoding the sequence rules that govern their activity.

The BPNet family of deep learning models: From regulatory maps to predictive sequence rules

We developed the BPNet family of deep learning models to address these questions. These neural networks use stacks of dilated residual convolutional layers to learn sequence features including TF motifs and their higher-order combinations and arrangements (called regulatory syntax) that can predict the biochemical activity measured by each experiment at every base, using up to approximately 2 kilobases of local DNA sequence context. Rather than simply classifying a region as active or inactive, BPNet models predict both the total amount of activity and the shape of the experimental signal at base-pair resolution. The deliberate choice of restricting the models to only use local-context makes them computationally efficient and amenable to robust sequence-level interpretation. Despite their compact architecture and restricted sequence context, these models are quite competitive with substantially larger models that use much longer genomic sequences.

The ENCODE GRAMMAR model resource contains four related model families:

BPNet: 2,339 TF ChIP-seq model sets spanning 788 transcription-factor targets.
ChromBPNet: 1,512 DNase-seq and ATAC-seq model sets across 408 biosamples.
ProCapNet: 6 PRO-cap model sets that predict transcription-initiation profiles.
ReporterNet: 8 model sets trained on high-throughput reporter assays. Unlike the above three models, ReporterNet makes predictions at the resolution of the candidate sequences tested in the experiments.

Together, these comprise 3,865 experiment-specific model sets, each trained and evaluated using five-fold cross-validation. They span diverse cell lines, primary cells, and tissues represented in ENCODE.

Schematic of the neural network architecture of the BPNet model family.
(Click the figure to see detailed legend)

The trained models are only one component of the resource. We also developed a suite of interpretation methods, described below, to interrogate each model and identify the cell-context-specific DNA sequence features that drive its predictions within biochemically active regulatory elements. For every experiment, ENCODE GRAMMAR provides several derived products:

Predicted regulatory profiles at base-pair resolution which often reveal de-noised signal profiles compared to the sparse, noisy measured profiles especially from TF ChIP-seq experiments.
Bias-corrected regulatory profiles for chromatin-accessibility assays, eliminating distortions in the profiles due to sequence biases of the Tn5 and DNase I enzymes used in ATAC–seq and DNase–seq, respectively.
Sequence-contribution maps estimating how much each DNA base contributes to a model’s prediction for individual regulatory sequences.
De novo predictive sequence motifs which are derived from recurrent patterns of high contribution scores with similar sequences across biochemically active regulatory sequences (e.g. peaks)
ENCODE Motif Compendium which is a unified lexicon of non-redundant sequence motifs derived from all ENCODE GRAMMAR models
Predictive genomic motif instances which map high-contribution sequence patterns in all biochemically active regulatory sequences to the unified motif lexicon.
Genome-browser tracks that allow predictions, contribution scores, motifs, and motif instances to be explored together at any genomic locus.

Together, this collection of models and derived annotations transforms thousands of ENCODE experiments into a practical, sequence-resolved atlas of gene-regulatory activity and its underlying predictive DNA features.

The ENCODE GRAMMAR resource transforms the extensive ENCODE compendium of genome-wide biochemical profiling experiments into predictive models and interpretable regulatory sequence annotations.
(Click the figure to see detailed legend)

Overview of the workflow for generating the ENCODE GRAMMAR resource

We describe the main steps of our workflow below. More detailed descriptions of the model architecture, evaluations and applications are available in the BPNet, ChromBPNet, and ProCapNet manuscripts.

(1) Train a set of sequence-to-profile models for each experiment: For each experiment, we train a deep learning model to predict the measured signal profile from the local DNA sequence surrounding biochemically active regions, together with background regions matched for overall sequence composition. The model is trained on a subset of chromosomes and evaluated on held-out chromosomes containing sequences never seen during training. Strong performance indicates that it has learned generalizable sequence features, including TF motifs and their combinations, spacing, and arrangement. We typically train at least five models per experiment using different chromosome splits, allowing us to estimate performance variability and obtain more stable predictions and interpretations by averaging across models. The resulting ensemble constitutes the experiment’s model set.

Train a sequence-to-profile deep learning model.
(Click the figure to see detailed legend)

(2) Predict sequence and variant effects: Once trained, a model can predict biochemical activity profiles for previously unseen DNA sequences. Because each model is trained on a single assay in a specific cellular context and receives only DNA sequence as input, it learns the sequence-to-activity relationship particular to that experiment. Its predictions should therefore not be extrapolated directly to other assays or cell types. Generalization is strongest for sequences whose regulatory syntax resembles that represented in the training data, although the models can often tolerate modest departures from this distribution. Genetic variants provide an important example. Although the models are trained only on reference-genome sequences and receive no explicit variant-effect labels, they can often predict the molecular effects of genetic variants quite effectively (See Fig. 6 in the ChromBPNet paper). We estimate a variant’s effect by comparing predictions for the reference and alternate sequences. Predictions are typically averaged across all models in the corresponding model set to improve robustness and stability, while variation among models provides an empirical estimate of uncertainty. The resulting change in signal quantifies the variant’s predicted effect on the specific biochemical activity measured by that experiment, not on downstream phenotypes such as disease risk.

Predict the biochemical effect of unseen sequences and genetic variants.
(Click the figure to see detailed legend)

(3) Separate biological signal from assay-specific sequence bias: ATAC-seq and DNase-seq profiles reflect both genuine chromatin accessibility distorted by the sequence preferences of the DNase I and Tn5 enzymes. ChromBPNet explicitly models these components. A sequence bias model learns the enzyme-driven signal, while the main model learns the remaining sequence-dependent accessibility signal. This bias-factorized prediction provides a cleaner estimate of the underlying regulatory profile, particularly at base-pair resolution.

Separate biological signal from assay-specific sequence bias.
(Click the figure to see detailed legend)

(4) Estimate quantitative base-resolution sequence contributions that drive predictions: How is the model making a particular prediction? One useful way to answer this is to ask which bases in the input sequence are responsible for the predicted activity and by how much. We use the DeepLIFT/DeepSHAP feature attribution method which efficiently approximates the model’s predictions for any input sequence as an additive sum of its base-resolution contributions. For a selected input sequence and its associated model prediction, DeepLIFT assigns a contribution score to each base such that the scores sum to the difference between the model’s prediction for the input sequence and its prediction for dinucleotide-shuffled reference sequences. Positive scores identify bases that increase the predicted activity relative to this reference, whereas negative scores identify bases that decrease it. For each sequence, we average contribution scores across all models in the corresponding model set to obtain more stable and robust estimates. The resulting sequence-contribution map highlights the individual bases and short sequence patterns that drive the model’s prediction. Many high-contribution patterns correspond to known TF binding sites, while others may reveal previously unrecognized predictive sequence features.

Estimate the contribution of each base in a query DNA sequences to a model’s prediction of biochemical activity.
(Click the figure to see detailed legend)

(5) Discover recurring predictive sequence motifs:. A single model can identify thousands of high-contribution sequence instances across biochemically active peaks across the genome. To summarize these recurring patterns, we developed the TF-MoDISco algorithm which samples highly contributing subsequences across peak regions, aligns and clusters similar subsequences and averages clusters into position specific contribution-weighted summary motifs. These motifs provide a compact representation of the sequence features learned by the model. Many can be matched to the known binding preferences of TF, helping identify regulators that may influence the experimental signal. Others often reveal previously unrecognized motifs, context-specific sequence preferences of TFs, or novel composite patterns recognized by complexes of multiple TFs.

Discover recurring predictive sequence motifs.
(Click the figure to see detailed legend)

(6) Map predictive motif instances across the genome: Each TF-MoDISco motif summarizes a cluster of similar high-contribution subsequences, but does not by itself identify all predictive instances of that motif in genomic or user-designed sequences with high sensitivity and specificity. This is challenging because motifs can overlap, share similar subpatterns, and compete to explain the same contribution signal. We developed FiNeMo to efficiently scan genome-wide sequence-contribution maps with a collection of TF-MoDISco motifs and jointly assign predictive sequence instances to the motifs that best explain them. The result is a quantitative genome-wide map of predictive motif occurrences from each model within biochemically active regulatory elements identified by the corresponding experiment.

Map predictive motif instances .
(Click the figure to see detailed legend)

(7) Unify motifs across all models into a non-redundant motif lexicon: Each model produces its own TF-MoDISco motifs, making it difficult to distinguish patterns that are shared across assays and cell types from those that are context specific. Comparing hundreds of thousands of contribution-weighted motifs is challenging because similarity must account for shifts, reverse complements, partial overlaps, and differences in contribution patterns. We developed MotifCompendium to efficiently cluster motifs discovered from all our trained models into a scalable, non-redundant lexicon, link them to known TF motifs, classify distinct motif types, and retain the models and contexts in which each was discovered.

Unify motifs across models.
(Click the figure to see detailed legend)

Case study: Decoding a MYC enhancer with the ENCODE GRAMMAR resource

To illustrate how the ENCODE GRAMMAR resource can be used to uncover the sequence basis of gene regulation, we examine a distal enhancer of the MYC gene in K562, a leukemia cell line. MYC encodes a transcription factor that promotes cell growth and proliferation, and dysregulation of MYC is a common feature of many cancers. We focus on a CRISPRi-validated enhancer of MYC at [chr8:127,898,412—127,899,647] and analyze its sequence using 15 independently trained models spanning chromatin accessibility and TF binding assays in K562.

A distal enhancer of the MYC gene in K562 leukemia cells.
(Click the figure to see detailed legend)

We first examine chromatin accessibility measured by DNase-seq and ATAC-seq. A separate ChromBPNet model was trained for each experiment and then used to predict its corresponding experimental profile. Both models closely recapitulate the broad shape and fine-scale structure of the observed signal at the enhancer, demonstrating that local DNA sequence contains substantial information about its accessibility in K562 cells.

Observed and ChromBPNet-predicted chromatin-accessibility profiles at the *MYC* enhancer.
(Click the figure to see detailed legend)

Closer inspection reveals that the raw observed and predicted DNase-seq and ATAC-seq profiles differ substantially, even though both assays measure chromatin accessibility. Much of this discrepancy arises because DNase I and Tn5 have distinct sequence preferences. ChromBPNet models the regulatory signal and assay-specific enzyme bias separately, producing bias-corrected accessibility profiles that more closely approximates the underlying biological signal. Although the DNase-seq and ATAC-seq models were trained independently, their bias-corrected predictions converge on a much more similar accessibility profile at the enhancer, helping reconcile the two assays.

Bias-corrected ChromBPNet accessibility profiles at the *MYC* enhancer.
(Click the figure to see detailed legend)

We next interrogate the ChromBPNet models using DeepLIFT to identify the DNA bases that influence their bias-corrected accessibility predictions. The sequence-contribution maps highlight multiple predictive motif instances associated with TFs active in K562, including GATA, AP-1, SP, ETV/ETS, and CEBP family proteins. The contribution maps are also highly reproducible across the DNase-seq and ATAC-seq models. These annotations move beyond identifying the enhancer as accessible and help nominate the specific sequence features that may help establish and maintain its accessibility.

Highly concordant sequence-contribution maps reveal shared regulatory features at the *MYC* enhancer.
(Click the figure to see detailed legend)

Finally, we compare the accessibility-derived annotations from ChromBPNet with sequence-contribution maps from BPNet models trained on TF ChIP–seq experiments. For each motif class identified by ChromBPNet, the corresponding TF-specific BPNet model assigns high contribution to the same genomic instances. For example, GATA sites are highlighted by the GATA2 model, AP-1 sites by the JUND (an AP-1 TF family member) model, and ETV/ETS sites by the GABPB1 (an ETS TF family member) model. Collectively, the TF-binding models account for most of the predictive motif instances identified by the accessibility models. This cross-assay agreement links individual sequence features to both chromatin accessibility and binding by specific TFs, providing a more detailed view of the enhancer’s regulatory sequence logic.

TF ChIP–seq BPNet models link ChromBPNet motif instances to specific TFs at the *MYC* enhancer.
(Click the figure to see detailed legend)

The example illustrates a central strength of ENCODE GRAMMAR: models trained on complementary ENCODE assays can be integrated at the same locus to connect experimental profiles with the individual DNA bases, motifs, and TFs that may drive different types of biochemical activity. The interactive browser below allows the experimental data, model predictions, sequence-contribution maps, and motif annotations to be explored together at the MYC enhancer:

What can researchers do with the ENCODE GRAMMAR resource?

GRAMMAR is designed to support analyses that would otherwise require training and interpreting thousands of models from scratch. Researchers can use it to:

explore base-resolution regulatory predictions and sequence-contribution maps in a genome browser;
identify candidate motifs, motif combinations and other sequence features that influence different types of biochemical activity of a candidate regulatory element in many cell types;
compare local and globally predictive sequence features across assays, cell types, and tissues mapped to a common unified lexicon;
predict the effects of non-coding genetic variants in diverse assay and cell contexts;
interpret what sequence features noncoding genetic variants may be disrupting to alter context-specific regulatory activity;
reuse trained models and derived annotations in new computational methods.

These models are most informative when interpreted together with experimental data and appropriate biological context. Their outputs provide testable hypotheses about the sequence determinants of regulatory activity, not substitutes for perturbation experiments or evidence of causal effects on downstream phenotypes.

Accessing the ENCODE GRAMMAR resource

All ENCODE data, models, and model-derived sequence annotations are openly available through the ENCODE portal.

2,339 TF ChIP-seq BPNet model sets spanning 788 transcription-factor targets.
1,512 DNase-seq and ATAC-seq ChromBPNet model sets across 408 biosamples.
6 ProCapNet model sets that predict transcription-initiation profiles.
8 ReporterNet model sets

Additional access points include:

Trained models: ENCODE GRAMMAR models on Hugging Face.
Predictions and sequence annotations: UCSC Track Hub, including model predictions, sequence-contribution maps, and motif instances.
Unified motif lexicon: ENCODE annotation ENCSR091GRD.
Software: BPNet code repo, ChromBPNet code repo, and ProCapNet code repo.
ENCODE 4 preprint
BPNet paper
ChromBPNet preprint
ProCapNet preprint

Please check out a detailed quick-start guide in our next blog post (out now).

From ENCODE maps to regulatory sequence rules

Over two decades, ENCODE has created an unprecedented map of regulatory elements across the human and mouse genomes. GRAMMAR adds a complementary layer of predictive models and sequence annotations that connect these experimental measurements back to the underlying DNA sequence.

By releasing nearly 4,000 experiment-specific model sets together with predictions, contribution maps, motifs, and motif instances, we hope to make regulatory sequence analysis more accessible, reproducible, and scalable. The goal is not to only predict where regulatory activity occurs, but to help researchers ask more mechanistic questions about which DNA bases, motifs, and their syntactic arrangements influence different types of biochemical activity of every regulatory element in every cellular context?

What’s next?

We still have so much to share about the resource! We are planning to regularly share the many different ways you can use the resource (~every week) for the foreseeable future, so give us a follow and be on the lookout for more.

References

The ENCODE Project Consortium et al. The Encyclopedia of DNA Elements. bioRxiv 2026.07.06.731365 (2026) (https://doi.org/10.64898/2026.07.06.731365)
Yun, C. M. et al. A unified lexicon of predictive DNA sequence motifs from ENCODE transcription factor binding and chromatin accessibility assays. (2025) doi:10.5281/zenodo.17179111. (https://doi.org/10.5281/zenodo.17179111)
Avsec, Ž. et al. Base-resolution models of transcription-factor binding reveal soft motif syntax. Nat Genet 53, 354—366 (2021). (https://doi.org/10.1038/s41588-021-00782-6)
Pampari, A. et al. ChromBPNet: bias factorized, base-resolution deep learning models of chromatin accessibility reveal cis-regulatory sequence syntax, transcription factor footprints and regulatory variants. bioRxiv 2024.12.25.630221 (2024). (https://doi.org/10.1101/2024.12.25.630221)
Cochran, K. et al. Dissecting the cis-regulatory syntax of transcription initiation with deep learning. bioRxiv 2024.05.28.596138 (2024). (https://doi.org/10.1101/2024.05.28.596138)
Shrikumar, A., Greenside, P. & Kundaje, A. Learning Important Features Through Propagating Activation Differences. arXIV (2019).(https://doi.org/10.48550/arXiv.1704.02685)
Lundberg, S. M. & Lee, S.-I. A unified approach to interpreting model predictions. in Proceedings of the 31st International Conference on Neural Information Processing Systems 4768–4777 (Curran Associates Inc., Red Hook, NY, USA, 2017). (https://dl.acm.org/doi/10.5555/3295222.3295230)
Shrikumar, A. et al. Technical Note on Transcription Factor Motif Discovery from Importance Scores (TF-MoDISco) version 0.5.6.5. arXiv (2020) (https://doi.org/10.48550/arXiv.1811.00416).