Job Information
CAI Data Engineer in India
Data Engineer
Req number:
R2641
Employment type:
Full time
Worksite flexibility:
Remote
Who we are
CAI is a global technology services firm with over 8,500 associates worldwide and a yearly revenue of $1 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately held company, we have the freedom and focus to do what is right—whatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors, and we are trailblazers in bringing neurodiversity to the enterprise.
Job Summary
We are looking for a Data Engineer. This position will be full-time.
Job Description
What You’ll Do
Involve in Design and Development in all phases of project.
Apply analytical and technical skills to create an efficient data operation.
Responsible for the Data Quality and Data validation.
Collaborate with team members and other data experts to create a high-functioning process.
Handling of Production & Administration activities.
What You'll Need
Minimum of 2 years’ experience in working with Spark and Data frames using Python.
Experience writing batch pipelines using Spark.
Experience to handle Semi/Un-Structured data using PySpark or Python.
Experience working with Delta lake.
Proficient on performance optimization techniques on Spark jobs.
Working experience with DevOps environment is an added advantage.
Proficiency in testing methodologies and validating data pipelines.
Proficient in SQL and database management systems.
Experience with working on Data Lake, Star Schema etc.
Demonstrated capability in constructing scalable data pipelines and ETL processes.
Familiarity with data warehousing, data quality assurance, and monitoring practices.
Working knowledge of any one of the public cloud platforms preferably Azure.
Physical Demands
Sedentary work that involves sitting or remaining stationary most of the time with occasional need to move around the office to attend meetings, etc.
Ability to conduct repetitive tasks on a computer, utilizing a mouse, keyboard, and monitor
Reasonable accommodation statement
If you require a reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employment selection process, please direct your inquiries to application.accommodations@cai.io or (888) 824 – 8111.
CAI
- CAI Jobs