code, html, digital-1076536.jpg

Data Engineer (Airflow Developer)

Data Engineer
Posted 4 weeks ago

As the Data Engineer for the Airflow Development, you will interact with team members and customers to deliver solutions and drive an effective implementation of this successful open-source community project. The company is a growing start-up based in California and has world-wide offices. The employees have made our company an industry leader as a customer focused, multi-cloud services business. This is a full-time, fully remote opportunity. Profits are shared with the company members, as well as a range of additional benefits.

What to expect:

  • Act as an advisor to assist in the architectural development of Airflow data pipelines.
  • Be the SME for customer education of Airflow best practices and technical function.
  • Support clients with Data Engineering as a Service.
  • Provide code refactoring assessments.
  • Work in partnership with the clients to design, prototype and implement proof-of-concept engineering solutions.
  • Collect feedback and identify improvements through client interactions.
  • Continue to look for opportunities to increase knowledge and help create future technology advancements.

What you will need:

  • 3 to 5 years of experience in Java and/or Scala in development.
  • 3 to 5 years of industry experience that includes Airflow in a production environment.
  • Advanced analytic skills.
  • Preferred: GCP
  • Knowledge of technology like: Google Cloud Anthos, Flink framework and distributed processing engines, Elasticsearch, NATs open-sourced messaging, ECE, MLOps to automate and scale the deployment and management of ML applications, Kafka event streaming platform.
  • Background using Java and/or Scala script to create graphs.
  • Understanding of Docker and Kubernetes.
  • Ability to implement ETL/ELT processes.

There is no sponsorship or C2C for this position. You must live in the United States.

Kw: data engineer, airflow, airflow developer, deaas, data engineering as a service, java, scala, dags, directed acyclic graphs, docker, kubernetes, etl, elt, gcp, anthos, flink, nats, elastic ece, kafka, mlops, analytics

Job Features

Job CategoryFull-time, Remote

Apply Online

Leave a Reply

Your email address will not be published.