Job Description

W2 Only role.

Data Engineer (Must have Databricks)

Need Mid level (3-5Yrs)

Location : North Quincy MA – Hybrid Onsite

Key Skill: Strong Databricks, AWS, Apache Spark, SQL, Scala/Python, Hadoop

Skill Sets Required

Good decision-making and problem solving skills
Solid understanding of Databricks fundamentals/architecture and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering and SQL warehouse).
Solid Knowledge on medallion architecture, DLT and unity catalog within Databricks.
Experience in migrating data from on-prem Hadoop to Databricks/AWS
Understanding of core AWS services, uses, and AWS architecture best practices
Hands-on experience in different domains, like database architecture, business intelligence, machine learning, advanced analytics, big data, etc.
Solid knowledge on Airflow
Solid knowledge on CI/CD pipeline in AWS technologies
Application migration of RDBMS, java/python applications, model code, Opensearch etc.
Solid programming background on scala and/or python with Spark
Experience with Docker and Kubernetes is a plus

Job Tags

Similar Jobs

Law Firm

Paralegal Job at Law Firm

...Job Title: Entry-Level Paralegal Location: Dallas, TX Job Type: Full-Time On-site About the Role: We are seeking a detail-oriented and highly motivated entry-level Paralegal to join our growing legal team. This role is an excellent opportunity for individuals...

Hanes Construction, Inc

Lead Carpenter Job at Hanes Construction, Inc

...member is valued and empowered to contribute their best. Role Description This is a full-time, on-site role for a Lead Carpenter at Hanes Construction, Inc., located in Napa, CA. The Lead Carpenter will be responsible for overseeing and managing carpentry projects...

Apollo ITS

Power BI Developer Job at Apollo ITS

Role: Power BI DeveloperLocation: Richmond, VA (Hybrid)Duration: 15 MonthsType: ContractNOTE: Power BI developer (with Power Platform exp). This one is really targeting Power BI more than the other DOE Power Platform Developer role that just opened. Pls submit the...

E2M Technologies logo

HR Internship Job at E2M Technologies logo

...vliegende start te geven en praktijkervaring op te doen in een dynamische omgeving? E2M Technologies is op zoek naar een enthousiaste HR-stagiair om ons team in Amsterdam te versterken! E2M Technologies BV, onderdeel van de wereldwijde MTS-familie, is een...

SCS Engineers

Project Engineer - Solid Waste Job at SCS Engineers

...to reduce greenhouse gas emissions and optimize operations at solid waste facilities. At SCS, our workplace culture is guided by three... ...Responsibilities include engineering design, client communications, project management, and staff coordination. Project responsibility will have a...

Data Engineer Job at Xoriant, Boston, MA

K1J2N0txdGFib1JtRkFkdkxPSnBMbXVn