An Attention-Based Model for Transcription Factor Binding Site Prediction
Gunjan Baid
EECS Department, University of California, Berkeley
Technical Report No. UCB/EECS-2018-83
May 19, 2018
http://www2.eecs.berkeley.edu/Pubs/TechRpts/2018/EECS-2018-83.pdf
We propose an attention-based approach for accurately predicting transcription factor binding sites. Our method combines DNA sequence with partially observed labels from epigenetic experiments to impute the values of missing labels, allowing for better predictions as more label information is known beforehand. We train and evaluate this model on cell lines from the ENCODE consortium and show that our model performs well on standard prediction tasks and further improves when partial data becomes available. The main contributions of our approach are generalization to unseen cell types and informed experimental design. Our model is able to reliably predict binding sites for cell types never seen during training. In addition, we use a beam search to identify the set of experimental labels that maximize prediction accuracy on missing data. The results of this beam search can be used to inform cost-efficient experimental design under limited resources.
Advisors: Anthony D. Joseph
BibTeX citation:
@mastersthesis{Baid:EECS-2018-83, Author= {Baid, Gunjan}, Title= {An Attention-Based Model for Transcription Factor Binding Site Prediction}, School= {EECS Department, University of California, Berkeley}, Year= {2018}, Month= {May}, Url= {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2018/EECS-2018-83.html}, Number= {UCB/EECS-2018-83}, Abstract= {We propose an attention-based approach for accurately predicting transcription factor binding sites. Our method combines DNA sequence with partially observed labels from epigenetic experiments to impute the values of missing labels, allowing for better predictions as more label information is known beforehand. We train and evaluate this model on cell lines from the ENCODE consortium and show that our model performs well on standard prediction tasks and further improves when partial data becomes available. The main contributions of our approach are generalization to unseen cell types and informed experimental design. Our model is able to reliably predict binding sites for cell types never seen during training. In addition, we use a beam search to identify the set of experimental labels that maximize prediction accuracy on missing data. The results of this beam search can be used to inform cost-efficient experimental design under limited resources.}, }
EndNote citation:
%0 Thesis %A Baid, Gunjan %T An Attention-Based Model for Transcription Factor Binding Site Prediction %I EECS Department, University of California, Berkeley %D 2018 %8 May 19 %@ UCB/EECS-2018-83 %U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2018/EECS-2018-83.html %F Baid:EECS-2018-83