top of page

Python/Hadoop Developer

New York, NY, USA

Job Type

Contract C2C

Workspace

Remote

About the Role

Job Description:
We are seeking an expert in designing and developing scalable systems to manage petabytes
of data. As part of the Enterprise Data Warehouse and Business Intelligence team, you will be
responsible for ingesting and preparing large volumes of data for reporting, dashboards,
self-service, and advanced analytics. This role involves collaborating closely with business
stakeholders to gather requirements and implementing solutions in an agile environment using
both traditional and modern technologies.
Key Responsibilities:
- Develop and maintain robust ETL processes to manage large-scale data.
- Utilize both traditional data warehousing technologies and modern tools like Hadoop and MPP
databases.
- Work with business teams to understand and implement their data requirements.
Required Qualifications:
- 5+ years of experience with DBMS and ETL tools.
- Advanced SQL skills with a strong understanding of database design for large data sets.
- Proficiency in Python programming and Shell scripting.
- Experience with the Hadoop ecosystem (HDFS, Spark).
- Strong problem-solving and troubleshooting skills.
- Degree in Computer Science, Engineering, or a related field (BA, BS, MS, PhD).
Preferred Qualifications:
- Experience with RDBMS and MPP systems.
- Familiarity with ETL tools such as Informatica.
- Experience with Airflow for orchestration.
- Experience in creating and maintaining BAS services.
- Experience in a UNIX or Linux development environment.
This role is suited for individuals who are passionate about building systems that enable
data-driven decision-making and advanced analytics on a large scale
Your collection is already set up for you with fields and content. Add your own content or import it from a CSV file. Add fields for any type of content you want to display, such as rich text, images, and videos. Be sure to click Sync after making changes in a collection, so visitors can see your newest content on your live site.

Requirements

  • This is placeholder text. To change this content, double-click on the element and click Change Content. To manage all your collections, click on the Content Manager button in the Add panel on the left.

  • This is placeholder text. To change this content, double-click on the element and click Change Content. To manage all your collections, click on the Content Manager button in the Add panel on the left.

  • This is placeholder text. To change this content, double-click on the element and click Change Content. To manage all your collections, click on the Content Manager button in the Add panel on the left.

  • This is placeholder text. To change this content, double-click on the element and click Change Content. To manage all your collections, click on the Content Manager button in the Add panel on the left.

About the Company

This is placeholder text. To change this content, double-click on the element and click Change Content. Want to view and manage all your collections? Click on the Content Manager button in the Add panel on the left. Here, you can make changes to your content, add new fields, create dynamic pages and more. You can create as many collections as you need.

Your collection is already set up for you with fields and content. Add your own, or import content from a CSV file. Add fields for any type of content you want to display, such as rich text, images, videos and more. You can also collect and store information from your site visitors using input elements like custom forms and fields.

Be sure to click Sync after making changes in a collection, so visitors can see your newest content on your live site. Preview your site to check that all your elements are displaying content from the right collection fields.

Apply Now
bottom of page