Job Title: Data Engineer
Location: Chicago, Illinois (On-Site)
Job Summary: We are supporting a search for a Data Engineer to join an enterprise data team focused on designing and developing modern data solutions. Our team is looking for a professional who can help build scalable pipelines, support data lake initiatives, and contribute to secure, high-quality data processing across a fast-paced environment.
Responsibilities:
- Design, architect, and develop cloud-based data solutions to ingest, process, and analyze large and diverse data sets.
- Build and optimize ETL workflows using Azure Databricks, PySpark, and Spark SQL, including data validation, error handling, and performance tuning.
- Develop data lake solutions for structured and unstructured data while supporting migration efforts toward modern technology platforms.
- Support testing, troubleshooting, documentation, and data security practices to ensure reliable, privacy-conscious data engineering delivery.
Required:
- Minimum of 5 years of experience as a data developer using Python, PySpark, Spark SQL, ETL knowledge, SQL Server, and ETL concepts.
- Bachelor’s degree in Information Science, Computer Science, Mathematics, Statistics, or a quantitative discipline in science, business, or social science.
- Experience in Azure Cloud Platform, Databricks, and Azure storage.
- Hands-on experience with PySpark, Databricks, and Spark SQL, along with knowledge of JSON, Parquet, and other file formats.
- Experience handling unstructured and semi-structured data in a data lake environment, with exposure to data streaming and event- or queue-driven pipelines.
- Strong written and verbal communication skills, including technical writing, plus the ability to work collaboratively in a fast-paced, cross-functional environment.
About SSI People: With over 26 years of industry experience, SSi People has built its reputation and expertise on putting people first. Everything we do works toward delivering exceptional experience for our consultants, our clients, and our internal team. Through a genuine commitment to people in everything we do. We have developed refined processes and a stellar internal team to deliver talent quickly. More importantly, we focus on building long-term relationships, not transactions. Putting people first is just what we do well.
By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from SSi People and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here: SSi People Privacy Policy