Staff Software Engineer – Data Engineering – CircleCI

Job Expired

CircleCI

Company Website: https://circleci.com/careers/
Remote Locations: Canada, United States
Job Type: Full Time

Job Overview:

CircleCI is looking for an experienced engineer who cares deeply about data engineering and the platform that powers data science. As a staff-level member of the Insights team, you will work closely with product, security, SRE, and your data engineering teammates to build, test and rapidly iterate on the platform and tools at the heart of our business.

Job Responsibilities:
  • Architect, implement, and maintain our data platform – including our data warehouses, data lakes, and big data infrastructure. This includes building ETL infrastructure, frameworks, and automation and help to support the jobs that run on it.
  • Help us improve the reliability of our data platform through testing, observability, and monitoring.
  • Build new services to help automate data ingestion and ETL processes.
  • Work with billion-row datasets, petabytes of storage, and optimize complex data pipelines.
  • Help support our Insights product engineering and Data Analytics teams through brainstorming, technical guidance, and occasionally collaborating on feature development
Job Requirements:
  • Deep data engineering experience – managing data lakes, data warehouses, and working with batch and streaming data pipelines, specifically in the AWS data stack including tools like S3 and Athena.
  • Experience writing, deploying, and operating high quality, well-tested, observable application code particularly with Python, Java, or Clojure.
  • Experience with distributed, big-data, cloud-based architecture utilizing multiple tools, frameworks and technologies including Spark, Docker, Kubernetes, and the AWS data stack.
  • Fluent in SQL with a strong understanding of data access and storage in theory and practice. Experience designing and documenting enterprise data models.
  • Proven understanding of testing and its value in operating services at scale, and how to implement and maintain a high standard of testing in practice.
  • Notable data security experience – experience anonymizing and generating obfuscated data sets, understanding of the principle of least access for securing data, technical understanding of encryption implementations, and identification and protection of PII
  • Experience working on an agile development team, utilizing CI/CD to quickly deliver incremental improvements.
How To Apply:

Click “Apply’ button to process your Job application!

More Information

  • This job has expired!