Job Title: Data Engineer – PySpark
Location: Pittsburgh, Pennsylvania (On-site)
Job Summary: We are seeking a highly skilled professional to join our team in supporting the construction of an enterprise-level data lake. Our team is responsible for delivering modernized data solutions that drive critical business initiatives and enhance advanced data delivery projects.
Responsibilities:
- Participate in daily scrum calls to collaborate on upcoming change release implementations and assigned work.
- Develop, test, and modernize data pipelines and coding for project advancement using PySpark and SQL transformation skills.
- Validate and reconcile data rigorously as part of structured, governed data ecosystems.
- Apply practical debugging and performance optimization skills to support complex project initiatives within an agile team environment.
Required:
- 4 to 5 years of post-college experience in software engineering or related fields.
- Expertise in Spark and SQL transformation, with strong experience in data pipeline development and data wrangling.
- Proficiency with Python, SQL, Git, and Linux; practical experience in Jenkins, Apache Spark, Hadoop, and object-oriented programming is preferred.
- Ability to operate in structured, governed data ecosystems, with a rigorous mindset for data validation and reconciliation.
About SSI People: With over 26 years of industry experience, SSi People has built its reputation and expertise on putting people first. Everything we do works toward delivering exceptional experience for our consultants, our clients, and our internal team. Through a genuine commitment to people in everything we do. We have developed refined processes and a stellar internal team to deliver talent quickly. More importantly, we focus on building long-term relationships, not transactions. Putting people first is just what we do well.
By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from SSi People and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here: SSi People Privacy Policy