CASY-MSCCN Jobs

Description:

The data engineer will collaborate closely with the growth and data foundation teams to define and create foundational data tables, migrate test tables while adhering to EDW standards, and build self-serve ETL frameworks capable of handling streaming and batch processing. The engineer will also take ownership of ETL workflows, ensuring data quality and availability, and integrate schema registry while establishing data lineage in coordination with other teams.

Scope of Work

● Foundational Data Tables:

■ Define and create foundational data tables for new features.

■ Ensure adherence to EDW standards.

● Test Tables Migration:

■ Collaborate with analytics partners to migrate test tables into the data foundation.

■ Validate and optimize migrated data.

● Self-Serve ETL Frameworks:

■ Build, scale, and optimize self-serve ETL frameworks for streaming and batch processing.

■ Own ETL workflows, ensuring data quality and availability.

● Collaboration with Data Engineering Teams:

■ Integrate schema registry into ETL processes.

■ Establish data lineage for all data domains in coordination with other teams.

Top Skills Details:

Python, SQL, ,ETL, ,Spark, AWS, Snowflake, Data warehouse ,Airflow/Terraform

About TEKsystems:

We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.

The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.