Lead PySpark Data Engineer (Onsite NYC) Job at Oakridge Staffing, New York, NY

bVhtWDVpaGFMZnpBY2NnNHpwQllDWXBvMnc9PQ==
  • Oakridge Staffing
  • New York, NY

Job Description

Global hospitality company is looking for an experienced Lead PySpark Data Engineer for their Midtown NYC headquarters.

Responsibilities :

  • Lead the in-house development of ETL/ELT data pipelines and data science projects.
  • Create and own data products, such as a recommendation engine or predictive model.
  • Provide key insights and analyses to senior stakeholders and executives.
  • Work with the Data Engineering team to design and develop data models.

Qualifications And Requirements

  • 5+ years of relevant professional experience in building AWS big data pipelines using Apache Spark.
  • Strong hands-on experience with programming in Python.
  • Expertise in SQL and analytical data modeling.
  • Hands-on experience in pipeline orchestration tools, like Apache Airflow.
  • Experience in PostgreSQL, Redshift, S3, AWS Lambda, Kinesis and Athena.
  • Previous work with cloud-based BI tools (such as Looker, and Quicksight) is a plus.
  • Strong organizational, problem-solving, and communications skills (must be able to do basic technical writing)

Job Tags

Similar Jobs

ManpowerGroup

Insurance Producer Job at ManpowerGroup

Responsibilities The Direct Sales Agent Specialist is responsible for the profitable growth and attainment of business goals by driving new business sales, and understanding customers needs to build rapport and trust This position drives sales, and builds and retains...

Rheem Manufacturing

Warehouse / Delivery Driver (Non-CDL) - Montgomeryville, PA Job at Rheem Manufacturing

 ...multifamily industries, and commercial properties across the Northeast. Were looking for a reliable Warehouse / Delivery Driver (Non-CDL) to be an essential part of our team, delivering excellent service and embodying our company values. The ideal candidate will have... 

UT Southwestern Medical Center

Associate or Full Professor; Implementation, Improvement, and/or Health System Science Job at UT Southwestern Medical Center

 ...The Peter ODonnell Jr. School of Public Health (OSPH) at UT Southwestern Medical Center (UTSW) in Dallas invites applications and...  ...statement. UT Southwestern Medical Center is committed to an educational and working environment that provides equal opportunity to all... 

Fincons

Remote Customer Service Representatives (English and Spanish, Direct Hire) Job at Fincons

 ...Were a growing US-based company hiring**Bilingual (Spanish/English)** Customer Service Representatives (CSRs)to support our pet care...  ...customer support, and love the idea of helping pet owners while working from home, you might be a perfect fit. * Inbound Calls: Assist... 

Vibra Healthcare

Clinical Liaison Job at Vibra Healthcare

 ...YOUR CAREER WITH VIBRA HEALTHCARE! We are seeking a Clinical Liaison to join our team!10K BONUS Responsibilities...  ...direct communication between the community, referral sources and physicians to their Vibra Hospital Team. Often serves as the face of Vibra...