Python + PySpark - Junior Developer Job at Compunnel, Inc., New York, NY

K2k3ZmcxVEVTSWZGWXFWVkMrMGN5WTNrRGc9PQ==
  • Compunnel, Inc.
  • New York, NY

Job Description

The Python + PySpark Junior Developer will be responsible for developing scalable data solutions using PySpark and Python. The role requires hands-on experience in data engineering, SQL, and cloud platforms such as AWS or Azure. The candidate should have strong problem-solving skills and experience in building efficient ETL pipelines for large-scale data processing. Key Responsibilities Develop and maintain data processing pipelines using Python and PySpark Design and implement ETL workflows for structured and unstructured data Optimize data storage, retrieval, and transformation processes Work with cloud platforms (AWS or Azure) to deploy and manage data solutions Write complex SQL queries for data transformation and analysis Collaborate with data engineers, analysts, and stakeholders to ensure data integrity and reliability Troubleshoot and resolve performance issues in data pipelines Required Qualifications 5+ years of experience in data engineering Strong proficiency in Python and object-oriented programming Hands-on experience with PySpark for large-scale data processing Proficiency in SQL for data manipulation and query optimization Experience with cloud platforms (AWS or Azure) Knowledge of ETL processes and data warehousing concepts Experience with Hadoop is acceptable Preferred Qualifications Experience in optimizing Spark jobs for performance and efficiency Familiarity with DevOps practices for data engineering Understanding of data governance and security best practices #J-18808-Ljbffr Compunnel, Inc.

Job Tags

Similar Jobs

Pattern Promotions

Public Relations Associate Job at Pattern Promotions

Job Title: Public Relations Associate Chicago, ILSalary: $37,000 - $49,000 per yearJob Type: Full-timeWork Type: In-person (strictly on-site)About UsPattern Promotions is a fast-growing marketing and promotions company dedicated to creating memorable brand... 

Entrepreneur Babes

Customer Support Representative - Work From Home Job at Entrepreneur Babes

[Customer Service / Remote] - Anywhere in U.S. / Competitive pay - As a Customer Support Rep at Entrepreneur Babes, you will: Respond to customer inquiries and concerns in a timely and professional manner; Communicate with customers through various channels such as email... 

Aulani, A Disney Resort & Spa

PBX Phone Operator - Full Time, $35.84/Hour Job at Aulani, A Disney Resort & Spa

 ...Free parking ~ Free theme park admission and much more! Operators are responsible for providing the Guests first experience with...  ...continue to provide great service as they assist our Guests in-house with questions and ensure their needs are met and exceeded. Operators... 

Aulani, A Disney Resort & Spa

Bell Services Support - Full-Time, $25.44/hour Job at Aulani, A Disney Resort & Spa

 ...work in a variety of areas, conditions and/or changing scheduled shifts/days off) Maintains clean and polished appearance...  ...per week, including early mornings, evenings, overnight shifts, weekends, and holidays. SUBMITTING YOUR APPLICATION After clicking... 

TECH Company, Northeast SA

Sales Development Representative Job at TECH Company, Northeast SA

 ...interactions and sales processes. Qualifications: Education: Bachelors degree required. Experience: Experience or internship in sales support, sales development, or CRM administration. Skills: Strong proficiency in HubSpot CRM. Excellent written...