PROSPECT and PROSPECT PTM (PROteometools SPECTrum compendium) are large annotated datasets, leveraging the raw data from ProteomeTools [1] [2], including unmodified and modified peptide sequences (with Post-Translational Modifications, PTMs).
The unmodified PROSPECT dataset includes examples without modifications. The PROSPECT PTM datasets include 4 datasets, each representing a common subgroup of modified peptide sequences. Dataset TMT includes peptide sequences labeled with Tandem Mass Tags, which are introduced experimentally for multi-plex analysis of samples. Dataset Multi-PTM includes examples rich with 13 unique PTM-residue pairs occurring naturally on proteins. We also curated and annotated the dataset TMT-PTM, which includes six unique PTM-residue pairs occurring in TMT-labeled sequences. Dataset Test-PTM, comprises 21 unique PTM-residue pairs and is well-suited as a hold-out/test dataset.
Dataset | Packages | Pools | Unique Peptides | Precursors | Sepctra | Annotated Peaks | Raw Peaks |
---|---|---|---|---|---|---|---|
PROSPECT Unmodified dataset |
12 | 983 | 838 K | 1.24 M | 61.7 M | 5.7 B | 24 B |
PROSPECT PTM TMT dataset |
11 | 1000 | 714 K | 820 K | 28.2 M | 1.8 B | 11.2 B |
PROSPECT PTM Multi-PTM dataset |
15 | 400 | 307 K | 413 K | 19.6 M | 2 B | 6 B |
PROSPECT PTM TMT-PTM dataset |
10 | 327 | 159 K | 189 K | 7.8 M | 511 M | 3 B |
PROSPECT PTM Test-PTM dataset |
25 | 56 | 10 K | 15.6 K | 3 M | 193 M | 732 M |
- Access to a collection of large annotated Mass Spectrometry datasets including peptide sequences with Post-Translational Modifications (PTMs).
- Utilities for downloading and splitting data.
Install with:
pip install git+https://github.com/wilhelm-lab/PROSPECT
- Install and import the package
import prospectdataset as prospect
- To download a specficic dataset, pass one or more of the available record names
['prospect'
,'tmt'
,'multi_ptm'
,'tmt_ptm'
,'test_ptm']
:
prospect.download_dataset(record = 'prospect', save_directory = SAVE_PATH)
- Available record names and URLs can be displayed as follows:
print(prospect.AVAILABLE_DATASET_URLS)
{'prospect': 'https://zenodo.org/record/6602020',
'multi_ptm': 'https://zenodo.org/record/11472525',
'tmt': 'https://zenodo.org/record/8221499',
'tmt_ptm': 'https://zenodo.org/record/11474099',
'test_ptm': 'https://zenodo.org/record/11477731'}
- To download data for retention time prediction only:
prospect.download_dataset(task = 'retention-time', save_directory = SAVE_PATH)
- To download data for MS/MS spectrum prediction (includes both metadata and spectra):
prospect.download_dataset(task = 'all', save_directory = SAVE_PATH)
- To download only one package from a specific dataset (for a faster download and a smaller dataset to experiment with), enter a substring from the package name, package names are in the respective Zenodo URL in the table. For example to download the package TUM_missing_first, the following would download the meta data file for the specfic package from the PROSPECT dataset:
prospect.download_dataset(
record = 'prospect',
task = 'retention-time',
save_directory = SAVE_PATH,
select_package = 'missing'
)
- All downloaded files are in the parquet format. They can be easily read using panda's
pd.read_parquet()
. For faster loading, we recommend usingfastparquet
as an engine, in case it fails for some reason,pyarrow
can also be used.
df = pd.read_parquet(PARQUET_FILEPATH, engine='fastparquet')
Download and unzip from the respective zenodo record, available records are:
The three following bash scripts can be used to perform data splitting, merge files, and to filter the retention time data (iRT). Once the package is installed, they are accessbile as bash commands on the system level. Use the option -h
to see the arguments of each script.
-
shuffle-split-data
: Shuffle and split data -
merge-files
: merge multiple files into one -
filter-irt
: filter iRT data to prepare for training.
The project is licensed under the MIT license.
The dataset is hosted on Zenodo PROSPECT DOI and is licensed under Creative Commons Attribution 4.0 International.
If you use PROSPECT and/or PROSPECT-PTM, please cite our papers PROSPECT: Labeled Tandem Mass Spectrometry Dataset for Machine Learning in Proteomics:
@inproceedings{prospect,
title={PROSPECT: Labeled Tandem Mass Spectrometry Dataset for Machine Learning in Proteomics},
author={Shouman, Omar and Gabriel, Wassim and Giurcoiu, Victor-George and Sternlicht, Vitor and Wilhelm, Mathias},
booktitle={Thirty-sixth Conference on Neural Information Processing Systems Datasets and Benchmarks Track}
}
[1] Daniel P Zolg, Mathias Wilhelm, Karsten Schnatbaum, Johannes Zerweck, Tobias Knaute, Bernard Delanghe, Derek J Bailey, Siegfried Gessulat, Hans-Christian Ehrlich, Maximilian Weininger, et al. Building proteometools based on a complete synthetic human proteome. Nature methods, 14(3):259–262, 2017.
[2] Zolg, D. P., Wilhelm, M., Schmidt, T., Médard, G., Zerweck, J., Knaute, T., ... & Kuster, B. (2018). ProteomeTools: Systematic characterization of 21 post-translational protein modifications by liquid chromatography tandem mass spectrometry (LC-MS/MS) using synthetic peptides. Molecular & Cellular Proteomics, 17(9), 1850-1863.