Adtalem Global Education logo

Adtalem Global Education

Senior Data Engineer

🇺🇸 Chicago, IL

🕑 Full-Time

💰 $85K - $149K

💻 Data Science

🗓️ October 21st, 2024

Airflow BigQuery CI/CD

Edtech.com's Summary

Adtalem Global Education is hiring a Senior Data Engineer in Chicago, IL. This is an on-site position where the individual will develop, deploy, and manage high-performance data pipelines and data platforms, supporting business decisions and AI operations.

Highlights
  • Work closely with business, IT, and data science teams to gather and implement business requirements.
  • Design and maintain data pipelines, ensuring performance, scalability, and reliability.
  • Implement CI/CD processes and ensure the quality of critical data elements.
  • Experience with Google Cloud services such as BigQuery, Composer, and others required.
  • The expected salary range is $84,835.61 to $149,076.17, with adjustments based on experience and other factors.
  • Requires Bachelor's or Master's Degree in Computer Science or related field, with extensive experience in data engineering solutions.
  • Expert knowledge of SQL and Python, with experience in Airflow, GCP Pub/Sub, Kafka, or Spark.
  • Benefits include health, dental, vision, life insurance, 401k with employer match, and flexible time off policy.

Senior Data Engineer Full Description

Company Description
Adtalem Global Education is a national leader in post-secondary education and leading provider of professional talent to the healthcare industry. Adtalem educates and empowers students with the knowledge and skills to become leaders in their communities and make a lasting impact on public health, well-being and beyond. Through equitable access to education, environments that nurture student success, and a focus on expanding and diversifying the talent pipeline in healthcare, Adtalem is building a brighter future for communities and the world.
 
Adtalem is the parent organization of American University of the Caribbean School of Medicine, Chamberlain University, Ross University School of Medicine, Ross University School of Veterinary Medicine and Walden University.
 
 Visit Adtalem.com for more information, and follow on  Twitter and LinkedIn.
 
Job Description
Adtalem is a data driven organization. The Data Engineering team builds data solutions that powers strategic and tactical business decisions and supports the Analytics and Artificial Intelligence operations. By implementing the data platform, data pipelines and data governance policies this team provides the basis for decision-making in Adtalem. Adtalem is looking for a Senior Data Engineer who is a technical powerhouse who can scale our data platform to meet ever growing business needs.
  • Work closely with various business, IT, Analyst and Data Science groups to collect business requirements.
  • Design, develop, deploy and support high performance data pipelines both inbound and outbound.
  • Model data platform by applying the business logic and building objects in the semantic layer of the data platform.
  • Optimize data pipelines for performance, scalability, and reliability.
  • Implement CI/CD pipelines to ensure continuous deployment and delivery of our data products.
  • Ensure quality of critical data elements, prepare data quality remediation plans and collaborate with business and system owners to fix the quality issues at its root.
  • Document the design and support strategy of the data pipelines
  • Capture, store and socialize data lineage and operational metadata
  • Troubleshoot and resolve data engineering issues as they arise.
  • Develop REST APIs to expose data to other teams within the company.
  • Mentor and guide junior data engineers.
  • Establish and support automatic data quality evaluation process on data pipelines.
  • Create and manage dashboards to publish data quality metrics.
  • Engage business stakeholders to identify and rectify data quality issues.
  • Complies with all policies and standards.

Qualifications
  • Bachelor's Degree Computer Science, Computer Engineering, Software Engineering, or other related technical field.
  • Master's Degree Computer Science, Computer Engineering, Software Engineering, or other related technical field. 
  • Two (2) plus years experience in Google cloud with services like BigQuery, Composer, GCS, DataStream, Dataflows.
  • Six (6) plus years experience in data engineering solutions such as data platforms, ingestion, data management, or publication/analytics. 
  • Expert knowledge on SQL and Python programming.
  • Experience working with Airflow as workflow management tools and build operators to connect, extract and ingest data as needed.
  • Experience in tuning queries for performance and scalability.
  • Experience in Real Time Data ingestion using GCP PubSub, Kafka, Spark or similar.
  • Excellent organizational, prioritization and analytical abilities.
  • Have proven experience working in incremental execution through successful launches.
  • Excellent problem-solving and critical-thinking skills to recognize and comprehend complex data issues affecting the business environment.
  • Experience working in agile environment.
  • Well versed in Data Quality Concepts (dimensions, reporting, workflows)
  • Working knowledge of data quality tools such as IDQ or similar.

Additional Information
In support of the pay transparency laws enacted across the country, the expected salary range for this position is between $84,835.61 and $149,076.17. Actual pay will be adjusted based on job-related factors permitted by law, such as experience and training; geographic location; licensure and certifications; market factors; departmental budgets; and responsibility. Our Talent Acquisition Team will be happy to answer any questions you may have, and we look forward to learning more about your salary requirements. The position qualifies for the below benefits.
 
 Adtalem offers a robust suite of benefits including:
  • Health, dental, vision, life and disability insurance
  • 401k Retirement Program + 6% employer match
  • Participation in Adtalem’s Flexible Time Off (FTO) Policy
  • 12 Paid Holidays

For more information related to our benefits please visit: https://careers.adtalem.com/benefits.
 
 You are also eligible to participate in an annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.
 
Equal Opportunity – Minority / Female / Disability / V / Gender Identity / Sexual Orientation