Art of Problem Solving
Data Engineer
🇺🇸 Hybrid - San Diego, CA
🕑 Full-Time
💰 $116K - $135K
💻 Data Science
🗓️ February 7th, 2025
DBT
Docker
Kafka
Edtech.com's Summary
Art of Problem Solving is hiring a Data Engineer. The role involves managing the data pipeline infrastructure, ensuring seamless data flow from sources to end users, and collaborating with Analytics Engineers for effective ELT pipeline maintenance. The Data Engineer will be responsible for implementing, optimizing, and monitoring data solutions using technologies such as Fivetran, Airbyte, Redshift, dbt Cloud, and Lightdash.
Highlights
- Manage and optimize data pipeline infrastructure.
- Utilize tools like Fivetran, Airbyte, Redshift, dbt Cloud, and Lightdash.
- Proficiency in SQL and Python required.
- Understanding of data modeling and warehousing needed.
- Experience in building and maintaining ELT pipelines.
- 3 - 5 years of data engineering experience.
- Salary ranges from $116K - $135K, with a 6% year-end bonus.
- Benefits include medical, dental, vision plans, 401K match, and PTO.
- Additional relocation bonus for candidates moving to San Diego.
Data Engineer Full Description
As a Data Engineer at AoPS, you will be the backbone of our data operations, enabling scalable and reliable access to data that drives mission-critical decisions across the organization. You will take ownership of our data pipeline infrastructure to ensure that data flows without error from sources to our end users. You will work closely with our Analytics Engineers to maintain the ELT pipeline, ensuring they have the data they need to design meaningful transformations. We deeply care about efficient orchestration and designing with observability in mind. Our pipeline is currently built on a combination of Fivetran, Airbyte, Redshift, dbt Cloud, and Lightdash using SQL, Python, and Go.
The Data Engineer will:
- Takes ownership of the data pipeline, from source ingestion to warehouse.
- Implements a pipeline orchestration solution with scheduling, monitoring, and error alerting for all pipeline exposures.
- Develops a deep understanding of AoPS data sources and business problems to inform choices about structuring and monitoring the data pipeline.
- Builds new data connections as needed with an appropriate tool for the use case (Fivetran, Airbyte, AWS Glue, AWS Lambda, etc.).
- Identifies opportunities to optimize the current data stack to produce more effective analytical solutions.
- Establishes processes as needed to ensure an error-free pipeline.
- Builds and maintains platforms that facilitate data exploration, machine learning model training, and experimentation for data analysts and data scientists.
The ideal candidate has:
- 3 - 5 years of experience in data engineering or a closely related role
- Experience with data transfer solutions like Fivetran, Airbyte, or AWS Glue
- Experience with data modeling, warehousing, and building ELT pipelines
- Experience with orchestrating dbt models in a DAG with other data pipeline components
- Experience with supporting the data velocity and availability requirements of analytics engineers and data analysts
- Advanced proficiency in data warehouses and SQL such as designing for scalability/performance, managing database access, and securing sensitive data
- Proficiency in Python programming language
- What would make you stand out:
- Experience with streaming data (e.g. Kineasis, Kafka)
- Experience with containerized deployment (e.g. Docker, Kubernetes)
- Experience with machine learning platforms (e.g. SageMaker, Databricks) and managing the infrastructure required to support model deployment.
Why Join AoPS:
This is a hybrid full-time position based at our headquarters in San Diego, CA. The full salary range for this position is 116k-135k with a 6% year-end bonus. Here are some things you can look forward to:
- Impact: Drive the scalability and reliability of our data infrastructure, powering analytics and innovation at AoPS.
- Culture: Work and collaborate with an organization filled with builders and life-long learners who strive to discover, inspire, and train the great problem solvers of the next generation
- Flexibility: Casual work environment with a hybrid work week and flexible scheduling
- Benefits: Multiple options for Medical, Dental and Vision plans
- Future Planning: 401K with company match
- Quality of Life: PTO Plan and supportive leadership that gives you the work-life balance you deserve
- Ease of Transition: Relocation bonus (if currently located outside of San Diego)
Background Check:
Please note that employment is contingent on the successful completion of a background check.
Work Authorization:
Please note that in order to be considered for this position you must be legally authorized to work in the US. We are unable to offer sponsorship, including STEM-OPT and H-1B.
About AoPS:
Art of Problem Solving (AoPS) is on a mission to discover, inspire, and train the great problem solvers of the next generation. Since 2003, we have trained hundreds of thousands of the country’s top students, including nearly all the members of the US International Math Olympiad team, through our online school, in-person academies, textbooks, and online learning systems. While our primary focus has been math for most of our history, through the years we have expanded our unique problem solving curriculum into more subjects, such as language arts, science, and computer science.
By clicking submit application you agree that we may contact you regarding your application via email, phone or SMS and to the terms of our data privacy policy.
