Job Description
Job Description - Role: Senior Data Engineer
Client: NiSource(Oil and Gas)
Location: Columbus, OH
Visa: or Permanent Resident/
Need LinkedIn id with profile Qualifications: - Must work in person at the Columbus, Ohio location 2 days per week (Tuesday and Wednesday) until September, then 3 days per week (Tuesday, Wednesday, and Thursday).
- Bachelor's Degree in Computer Science or related technical field AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, or Java.
- Proficiency with Azure data services, such as Azure Data Lake, Azure Data Factory and Databricks.
- Expertise using Cloud Security (i.e., Active Directory, network security groups, and encryption services).
- Proficient in Python for developing and maintaining data solutions.
- Experience with optimizing or managing technology costs.
- Ability to build and maintain a data architecture supporting both real-time and batch processing.
- Ability to implement industry standard programming techniques by mastering advanced fundamental concepts, practices, and procedures, and having the ability to analyze and solve problems in existing systems.
- Expertise with unit testing, integration testing and performance/stress testing.
- Database management skills and understanding of legacy and contemporary data modeling and system architecture.
- Demonstrated leadership skills, team spirit, and the ability to work cooperatively and creatively across an organization
- Experience on teams leveraging Lean or Agile frameworks.
Responsibilities: - Participate as a member of the Enterprise Data Lake Agile team.
- Understand requirements, plan the upcoming work needed, analyze source data systems, and create components required for the data lake (with a focus on ingestion from our production systems).
- Design, program, build, deploy, and maintain software applications and systems such as databases, cloud, or other components required for NiSource data Lakes.
- Analyze and modify existing software as well as design, construct, and test.
- Participate in full development life cycle including requirements analysis and design.
- Write technical specifications based on conceptual design and stated business requirements.
- Support, maintain, and document software functionality.
- Identify and evaluate new technologies for implementation.
- Analyze code to find causes of errors and revise programs as needed.
- Consult with end user to prototype, refine, test, and debug programs to meet needs.
- Deliver complex work, unsupervised and with extensive latitude for independent judgment.
- Pair and collaborate closely with other data engineers on the team.
- Conduct code reviews to ensure code quality, adherence to standards, and knowledge sharing among team members.
Comments/Special Instructions: Please provide technical interview/assessment notes for candidates when submitting.
Job Tags
Permanent employment, 2 days per week, 3 days per week,