Data Engineer Senior Consultant
NTT DATA Global Delivery Services Ltd
Work from Office
Full Time
Min. 5 yearsJob Description
Data Engineer Senior Consultant
Key Responsibilities
• Assess complex Informatica workflows including sessions, mappings, and parameterizations and translate them into equivalent Python EL scripts and dbt transformation models.
• Develop and maintain Python EL pipelines to land high-volume data, including billion-row tables, into the target warehouse using SQLAlchemy, cx_Oracle, pyodbc, and bulk export tools such as Oracle Data Pump and SQL Server BCP.
• Design and develop dbt transformation models based on Informatica mapping logic, incorporating dbt best practices including model layering, macros, incremental strategies, and snapshot patterns.
• Develop dbt-native tests as well as custom Python unit tests to validate transformation correctness and data quality.
• Develop Airflow DAGs to orchestrate Python EL and dbt scripts end-to-end, producing output that is functionally equivalent to the source Informatica workflows.
• Contribute to GitLab CI/CD pipeline for dbt and Airflow code, including lint gates, automated testing, and deployment to shared NAS.
• Perform peer code reviews and provide constructive technical feedback to fellow engineers.
• Troubleshoot performance issues and data discrepancies during SIT and UAT, including row-count reconciliation between source Oracle/SQL Server systems and the target warehouse.
• Contribute to technical documentation, runbooks, and handover materials.
Experience Level
Senior LevelJob role
Job requirements
About company
Similar jobs you can apply for
Accounts / Finance
Reservation Sales Associate
Mind Choice ServicesWork from OfficeFull TimeMin. 1 year
Good (Intermediate / Advanced) EnglishFTTH Technician / Internet Installation & Fiber Splicing Technician – Freshers & Experienced
Zas Ventures
Field JobFull TimeAny experienceNo English RequiredTelecalling Executive
Harshika DevelopersWork from OfficeFull TimeMin. 6 monthsNo English RequiredClinical Nurse Specialist
Avyaan Super - Speciality Clinics Private LimitedWork from OfficeFull TimeAny experienceBasic English
Business Development Manager (BDM)
TAP Edtech Private LimitedWork from OfficeFull TimeMin. 2 yearsGood (Intermediate / Advanced) English
Machine Operator / Machinist
Adithya EngineeringWork from OfficeFull TimeMin. 2 yearsNo English RequiredYou can expect a minimum salary of 0 INR. The salary offered will depend on your skills, experience and performance in the interview.
The candidate should have completed the required education and people who have 5 to 31 years are eligible to apply for this job. You can apply for more jobs in Bengaluru/Bangalore to get hired quickly.
The candidate should have sound communication skills and sound communication skills for this job.
Both Male and Female candidates can apply for this job.
No, it's not a work from home job and can't be done online. You can explore and apply for other work from home jobs in Bengaluru/Bangalore at apna.
No work-related deposit needs to be made during your employment with the company.
Go to the apna app and apply for this job. Click on the apply button and call HR directly to schedule your interview.
The last date to apply for this job is . For more details, download apna app and find Full Time jobs in Bengaluru/Bangalore . Through apna, you can find jobs in 64 cities across India. Join NOW!