Data Engineer Job at Qode, Pennsylvania

clgzUzNFd2ZTUHl6dXZtczYyUlJMVXp6R2c9PQ==
  • Qode
  • Pennsylvania

Job Description

Job Summary:

We are seeking a skilled and motivated Data Engineer with strong expertise in PySpark, SQL to join our Data Engineering team. You will be responsible for designing, building, and maintaining scalable data pipelines and processing systems that support our business intelligence, analytics, and machine learning initiatives.

Key Responsibilities:

  • Develop and maintain scalable, robust data pipelines using Scala and big data technologies.
  • Work with large datasets from multiple sources to ingest, transform, and make data available for analytics and reporting.
  • Collaborate with Data Scientists, Analysts, and other engineers to understand data requirements and deliver efficient solutions.
  • Optimize ETL jobs for performance and cost.
  • Ensure data quality, governance, and consistency across all environments.
  • Monitor production jobs, troubleshoot issues, and ensure system reliability.
  • Implement best practices for data engineering, including code reviews, testing, and documentation.

Required Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
  • 6+ years of experience as a Data Engineer or in a similar role.
  • Strong skills in PySpark and SQL (experience with functional programming is a plus).
  • Hands-on experience with big data tools like Apache Spark , Kafka , Hadoop , or Hive .
  • Proficiency in building ETL pipelines and working with structured and unstructured data.
  • Experience with cloud platforms (e.g., AWS , Azure , GCP ) and their data services.
  • Familiarity with version control systems (e.g., Git ), CI/CD, and DevOps practices.
  • Solid understanding of data warehousing and data modeling concepts.

Preferred Qualifications:

  • Knowledge of SQL and database systems such as Postgres, Redshift, or Snowflake.
  • Exposure to containerization technologies like Docker and orchestration tools like Airflow or Kubernetes.

Job Tags

Full time,

Similar Jobs

St. Thomas Rheumatology Consultants PLLC

Medical Assistant Job at St. Thomas Rheumatology Consultants PLLC

 ...Job Title: PRN Medical Assistant Location: Nashville, TN (with occasional travel to satellite clinic) Job Type: PRN (As-Needed Basis) Job Description: St. Thomas Rheumatology Consultants, one of the most respected rheumatology groups in the region, is seeking... 

CommonSpirit Health

Pharmacist Clinical Job at CommonSpirit Health

 ...time to embrace it, live it and put it to work. We value incredible people with...  ...value even more.Join our team as a Clinical Pharmacist. This position interprets provider orders...  ...Unit. It also serves as southern Colorado's home base for the Flight For Life Colorado air... 

Bureau Works

Freelance translator (remote) Job at Bureau Works

More than a translation management system With Bureau Works' context-first translation platform, localization managers, translation agencies, translators, and devs alike can translate, contextualize, and scale global experiences that get results - all backed by enterprise...

Archdiocese of St. Louis

Technician - Audio Visual Job at Archdiocese of St. Louis

 ...Production: Operate livestreaming equipment for Masses Ensure audio, video, and lighting settings are optimized for reverent and...  ...Catholic liturgy and sensitivity to sacred space and reverent visual framing. Ability to work independently and troubleshoot under... 

BAE Systems

INTEL ANALYST Job at BAE Systems

 ...BAE SYSTEMS - Defense Contractor Job Description BAE SYSTEMS - Defense Contractor BAE Systems is seeking junior Intelligence professionals to work at our government customer site in Vienna, VA. This program consists of a large team working in various...