We re seeking a skilled Python Engineer to support the migration of legacy ETL pipelines built in Pentaho Data Integration (PDI/Spoon) to modern cloud-based solutions such as Azure Data Factory (ADF). This role involves translating transformation logic, validating data integrity, and collaborating with cross-functional teams to ensure a smooth transition.
Note : Mandatory Experience
Required Skills
Strong proficiency in Python for data manipulation and automation.
Hands-on experience with Pentaho Data Integration (PDI)
5 7 years of experience in data engineering or ETL development.
Solid understanding of ETL/ELT concepts, data warehousing, and data modeling.
Experience with SQL (joins, aggregations, subqueries).
Familiarity with Azure Data Factory, cloud storage (Blob, Data Lake), and DevOps tools.
Version control using Git or Azure DevOps.
Basic scripting in PowerShell or Shell is a plus.
Key Responsibilities
Analyze and document existing Pentaho ETL jobs, transformations, and data flows.
Translate Pentaho logic into Python scripts and/or ADF pipeline components.
Develop and maintain scalable Python-based data processing solutions.
Validate data accuracy post-migration using automated testing and SQL queries.
Collaborate with data engineers, architects, and QA teams to troubleshoot issues.
Create technical documentation and participate in knowledge transfer sessions.
Qualifications
Bachelor s degree in Computer Science, Engineering, or related field.
Prior experience in migration projects is highly desirable Soft Skills.
Detail-oriented with a meticulous approach to data validation.
Strong communication and documentation abilities.
Collaborative mindset with a proactive attitude.
...Bench Jeweler James Free Jewelers is currently seeking an experienced bench jeweler. We are looking for candidates with knowledge of stone setting, sizing, polishing, and jewelry repair. Job Description: Our bench jewelers are dedicated to delivering a customer...
...Antoines Bakery Metairie in Metairie, LA is looking for a professionally trained cake decorator to join our staff. We are located on 3030 Severn Ave. Our ideal candidate is attentive, ambitious, and reliable. Benefits ~ We offer many great benefits, including free...
...Overview We are seeking a skilled and detail-oriented CNC Machinist to join our dynamic team in Springfield, IL, 62703. In this role, you will be responsible for operating CNC machines to produce precision parts and components. If you have a passion for machining and...
...many imported top brand car authorized dealer in Central China: Bentley, Martha Lahti, Porsche, BMW, Mercedes, Jaguar, Land Rover,Volkswagen, Opel, Saab, Dodge, Chrysler, JEEP, Guangzhou Toyota, Shanghai Volkswagen Skoda, FAW Volkswagen and FAW Mazda6, etc.Now, for the...
...Warehouse/Production Assistant - Coffee Roastery Caffe Luxxe is looking for a warehouse/production assistant to join our team based at our headquarters and coffee roaster in Gardena. JOB DESCRIPTION: This person will assist the Operations and Production Supervisor...