Genovalia data platform
A catalogue of research datasets, standardised description schemas, a metadata API and a data explorer, running on Université Laval’s OpenShift cluster. Designed, built and operated end to end.
Genovalia is a Université Laval research programme in animal genomics. Its scientists and their partners need to find datasets, understand what is in them, and ask for access. The platform is what lets them do that.
What it is
- A data catalogue of research datasets, described once and published wherever they're needed, including a catalogue built for Genome Canada's CSDCC data hub.
- A metadata API that serves those descriptions and their schemas to the catalogues. I led its redesign.
- A data explorer for browsing and querying what's in the datasets.
- Standardised schemas that make all of the above consistent: see Metadata standards for animal genomics.
How it runs
Everything runs on the university's OpenShift cluster, with PostgreSQL and S3 object storage on Ceph. Each service ships through GitHub Actions and versioned Kustomize manifests across development, test and production. Sign-in goes through Keycloak with OpenID Connect and ORCID, and Sentry and Gatus (error tracking and uptime checks) watch it in production.
I design the services, write much of the code, run the platform day to day and coordinate the other developers.