Enabling compliance with ORD standards for cutting-edge time-resolved experiments at high data-rates
Category
Institutions
Data type
Field
Researchers
Abstract
The upcoming Swiss Light Source 2.0 machine upgrade and the advent of free electron lasers (SwissFEL) enable novel advancements in X-ray science. One emerging technique is time-resolved serial crystallography, providing insight into biomolecular processes at micro- and millisecond timescales but generating extensive data. A single experiment can produce a continuous stream of X-ray images at 2,000 images per second (17 GB/s), leading to terabytes of data. Managing such large datasets in public repositories is challenging. This project aims to enhance data accessibility by creating reduced datasets. Existing protein diffraction labeling algorithms will filter images to include only high-quality diffraction images, approximately 0.1-10% of the total. These reduced datasets will be available in the PSI public data repository, alongside the complete dataset, improving data interoperability and findability by adding labeling results to the metadata.