Kyndryl, Inc. Data Engineer in Bangalore, India
Your Role and Responsibilities
Be responsible for developing and maintaining complex data pipelines, ETL, data models and standards for various data Integration & data warehousing projects from source to sinks on Saas/Paas platforms - snowflake, databricks, Azure Synapse, Redshift, BigQuery, etc
Develop scalable, secure and optimized data transformation pipelines and integrate them with downstream sinks
Provide support to technical solutions from data flow design and architecture perspective, ensure the right direction and propose resolution to potential data pipeline-related problems.
Participate in developing Proof of concepts (PoC) of key technology components to project stakeholders
Developing scalable and re-usable frameworks for ingesting of geospatial data sets
Develop connectors to extract data from source and use event / streaming services to persist and process data into sinks
Collaborate with other members of the project team (Architects, Sr Data Engineers) to support delivery of additional project components (like API interfaces, Search, visualization)
Participate in evaluation and creation of PoVs around the performance aspects of data integrations tools in the market against customer requirements
Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.
Required Technical and Professional Expertise
Data Engineer with 7+ years of experience with following skills -
Must have 2+ years of experience working as a Data Engineer in cloud transformation projects in the areas of data management solutions - AWS or Azure or GCP or Snowflake, Databricks etc.
Must have hands on experience at least one end to end implementation of data lake/warehouse projects using Paas and Saas - such as Snowflake, Databricks, Redshift, Synapse, BigQuery etc. and 2+ data warehouse/data lake implementations on-premise
Experience in data pipelines development, ETL/ELT, implementing complex stored Procedures and standard DWH and ETL concepts
Experience in setting up resource monitors, RBAC controls, warehouse sizing, query performance tuning, IAM policies, Cloud networking (VPC, Virtual Network etc)
Experience in Data Migration from on-premise RDBMS to cloud data warehouses
Good understanding of relational as well as NoSQL data stores, methods and approaches (star and snowflake, dimensional modelling)
Hands-on experience in Python, PySpark, programming for data integration projects
Good experience in Cloud data storage (Blob, S3, Object stores, Minio), data pipeline services, data integration services, data visualization
Support in providing resolution to an extensive range of complicated data pipeline related problems, proactively and as issues surface
Preferred Technical and Professional Experience
NoSQL/Key-value, Data Vault 2.0 concepts knowledge
Cloud Cerfitication - Data Engineering
Experience in Agile development methodologies
Understanding of cloud network, security, data security and data access controls and design aspects
Required Education Bachelor's Degree
Preferred Education Master's Degree
State / Province KARNATAKA
City / Township / Village Bangalore
Being You @ Kyndryl
Kyndryl is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, age, veteran status, or other characteristics. Kyndryl is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
Other things to know
When applying to jobs of your interest, we recommend that you do so for those that match your experience and expertise. Our recruiters advise that you apply to not more than 3 roles in a year for the best candidate experience.
For additional information about location requirements, please discuss with the recruiter following submission of your application.
Primary job category Software Development & Support
Role ( Job Role ) Software Developer
Employment Type Full-Time
Contract type Regular
Position Type Early Professional
Travel Required No Travel
Company (Y030) Kyndryl Solutions Private Limited
Is this role a commissionable/sales incentive based position? No
- Kyndryl, Inc. Jobs