ClearML
ClearML→

Senior Software Engineer, Data

Full-timeNew York, NY, United StatesEngineering2mo ago

Job Overview

CLEAR is building THE secure identity company of the future. Our mission is to make experiences safer and easier—physically and digitally. With more than 43 million Members and a growing network of partners across the world, CLEAR's secure identity platform is transforming the way people live, work, and travel. Whether it’s at the airport, stadium, or throughout your everyday life, CLEAR unlocks the magic of frictionless experiences.

As a Senior Software Engineer, Data, you will design, build, and operate the next generation of our data platform and products – going beyond ID to power a networked digital identity – while keeping member privacy, security, and reliability at the core.

What you’ll do

  • Build and operate scalable, reliable data systems and pipelines – from ingestion to modeling to visualization – so Analysts and Engineers can self-service changes in an automated, tested, secure, and high-quality manner.
  • Develop and maintain end-to-end data products and pipelines (batch and/or streaming) that collect, clean, transform, and model data, and own the infrastructure that powers them to unlock new business use cases and reporting.
  • Implement and maintain infrastructure-as-code, CI/CD, and shared developer tooling for data products (e.g., Pulumi/Terraform, GitHub, orchestration tools like Dagster/Airflow) to make it easy and safe for teams to build, test, and ship changes across environments.
  • Improve the security, compliance, and cost posture of the data stack through robust dependency management, IAM and secrets hardening, observability, and performance/cost optimizations.
  • Partner with product and other stakeholders to uncover requirements, make architectural decisions, and continuously improve our data platform and processes.

How you’ll measure success

  • Data reliability & SLAs: % successful pipeline runs, adherence to freshness SLAs for core datasets, and reduction in data-related incidents impacting stakeholders.
  • Platform quality & efficiency: Reduction in critical/high security and dependency findings, improvements in IAM/secrets posture, and optimizations to infrastructure and job run costs.
  • Delivery throughput & self-service enablement: Lead time from request to production for new data sources and models, adoption and effectiveness of self-service tooling, reduction in manual engineering support for common workflows, and on-time delivery of roadmap initiatives.

What you’re great at

  • 6+ years of data engineering experience with strong Python and SQL skills, including designing and operating scalable batch and/or streaming data pipelines and orchestration (e.g., Dagster, Airflow, Luigi, dbt, Snowflake, Spark, Kafka, Databricks, or similar technologies).
  • Working with cloud-based application development and data platforms, including AWS services, modern data warehouses (e.g., Snowflake), evaluating different data platform integration tooling (e.g. APIs, CDC, batch ingestion, streaming) and coll

Core Requirements

Engineering