Job Description

Job Title: Python / PySpark / AWS Glue

Location: Malvern, PA
Employment Type: Contract

Job Description:
We are looking for a highly skilled and self-driven Python Developer with strong experience in building and optimizing data pipelines using Python , PySpark , and AWS . The ideal candidate will have a deep understanding of AWS cloud data services and hands-on experience in working with relational databases and ETL tools.

Key Responsibilities:

Design, build, and manage scalable and efficient ETL/ELT pipelines using AWS, Python, and PySpark .
Integrate and transform data from various sources such as Aurora, PostgreSQL, Redshift , and other RDBMS.
Work with Informatica or other ETL tools to manage legacy and hybrid data pipelines.
Utilize AWS services including:
- Athena, S3 for data storage and query
- EMR/EC2 for big data processing
- Lambda, CloudWatch, and EventBridge for automation and monitoring
Develop and manage containerized workloads using Docker/ACS .
Ensure data quality, performance tuning, logging, and error handling for robust pipeline operations.
Collaborate with cross-functional teams to gather requirements, propose solutions, and support analytics and reporting needs.

Required Skills:

Strong programming skills in Python and PySpark
Proven experience with AWS and AWS cloud services (S3, Athena, Lambda, EMR, EC2, CloudWatch, EventBridge)
Experience with relational databases like Aurora, PostgreSQL, and Redshift
Hands-on with ETL tools (preferably Informatica or similar)
Experience with Docker or AWS Container Services (ACS)
Solid understanding of data warehousing, data lakes, and best practices for data engineering on the cloud

Nice to Have:

Experience with CI/CD pipelines for data workflows
Knowledge of data governance, cataloging, and lineage tools
Familiarity with DevOps or IaC tools like Terraform or CloudFormation

Regards,

Bhargav Mylavarapu | Delivery Lead,

LinkedIn | bhargav.mylavarapu@centstone.com

CENTSTONE SERVICES

Address: 3400 State Route 35, Suite 9B, Hazlet, New Jersey, 07730 USA

Job Tags

Contract work,

Similar Jobs

SGI Global, LLC

Counter Drug/Transnational Organized Crime Analyst Job at SGI Global, LLC

SGI Global is seeking a Senior Analyst to join our team! This role will one of our clients, and conduct all-source network analysis of counter narcotics and Transnational Organized Crime (TOC). The position requires strong operational intelligence support experience from...

Carters

Assistant Store Manager - Retail Job at Carters

...in the marketplace. These brands are sold in leading department stores, national chains, and specialty retailers domestically and internationally... ...is available at Walmart, its Just One You brand is available at Target, and its Simple Joys brand is available on Amazon. The Company...

Veritis Group Inc

Assistant Manager Job at Veritis Group Inc

...Competencies: Division-Level P&L Management Strategic Planning & Execution Executive-Level Presentation Skills Cross-Functional Team Leadership & Direction C-Level Stakeholder Engagement & Consulting Global Program Management (Multi-Million Dollar Projects...

Smith Wine & Spirits

Sales Consultant for Distributor Job at Smith Wine & Spirits

...South Africa, and France for fast growing distributor focused on artisan products that are... ...We are looking for highly motivated and independent salespeople with at least some wine... ...offers both flexibility and long-term opportunity. Flexible work hours and work environment...

KRG Technologies Inc.

AS400 Programmer - Cobol - Contract - Miami, FL Job at KRG Technologies Inc.

...CA 91355Direct: (***) ***-**** Ext: 251 | An Inc.5000 CompanyJob Description Should have hands-on development experience in AS400, Cobol.Expertise in Hawkeye tool for doing impact analysis.Experience in SQL, Mainframe and TTL Domain is an added advantage.#J-18808-Ljbffr...

Senior Python Developer W/AWS Job at Centstone, Malvern, PA

OWhQd0lheFZiNHRqSGcxaUxPVnRMMlduRGc9PQ==