Lead PySpark Data Engineer (Onsite NYC) Job at Oakridge Staffing, New York, NY

bVhtWDVpaGFMZnpBY2NnNHpwQllDWXBvMnc9PQ==
  • Oakridge Staffing
  • New York, NY

Job Description

Global hospitality company is looking for an experienced Lead PySpark Data Engineer for their Midtown NYC headquarters.

Responsibilities :

  • Lead the in-house development of ETL/ELT data pipelines and data science projects.
  • Create and own data products, such as a recommendation engine or predictive model.
  • Provide key insights and analyses to senior stakeholders and executives.
  • Work with the Data Engineering team to design and develop data models.

Qualifications And Requirements

  • 5+ years of relevant professional experience in building AWS big data pipelines using Apache Spark.
  • Strong hands-on experience with programming in Python.
  • Expertise in SQL and analytical data modeling.
  • Hands-on experience in pipeline orchestration tools, like Apache Airflow.
  • Experience in PostgreSQL, Redshift, S3, AWS Lambda, Kinesis and Athena.
  • Previous work with cloud-based BI tools (such as Looker, and Quicksight) is a plus.
  • Strong organizational, problem-solving, and communications skills (must be able to do basic technical writing)

Job Tags

Similar Jobs

Blue Signal Search

Office Administrator - Construction / Manufacturing Operations Job at Blue Signal Search

 ...Job Title : Office Administrator Construction / Manufacturing Operations Location: Jacksonville, FL (Onsite Only) Schedule:...  ...behind a desk and hands-on when needed (shop floor, supplies) Experience in construction, manufacturing, or similar physical environments... 

Tata Consultancy Services

Hadoop Developer Job at Tata Consultancy Services

 ...Hadoop Admin (Hortonworks & Big Data - Cloudera)-Understand, monitor, and evaluate production Hadoop job streams in support of Bank...  ...distributions (Horton, Cloudera, Pivotal)-Experience with architecting developing applications on Hortonworks (HIVE, SPARK), Apache NiFi, Talend... 

Insight Global

Data Administrator - Accounts Payable Job at Insight Global

Data Administrator (Accounts Payable) Duration: 6 month contract, potential extensions Location: Fully remote, must work 8:00 AM -5:00 PM PST shift Start: Must be available to start 6/16 Pay: $23.50/hr Data analytics/admin background Strong Accounts Payable...

Cogar Manufacturing, Inc.

Computer Numerical Control Machinist Job at Cogar Manufacturing, Inc.

 ...Were Hiring: Night Shift CNC Machinist Join the Cogar Manufacturing Team at our Pearisburg, VA Machine Shop! If youre a skilled...  ..., Dental, and Vision Insurance Life Insurance Paid Time Off Full-Time, 4x10 Shifts (No weekends!) At Cogar, youll be part... 

CRG

Customer Support Specialist Job at CRG

 ...Customer Support Specialist Our client, a consultancy leader within their industry, is on the search for multiple Customer Support professionals...  ...onsite (ONE weekend day required per month - but that day is remote!) Pay/Compensation: $22-$24/hour depending upon experience....