Senior Data Engineer

Title

Senior Data Engineer

Classification

Exempt

Reports To

VP of Strategy & Technology

Position Type

Full-Time

CORE VALUES

Schupan expects all employees to perform their job duties and consistently follow the code of conduct, exhibiting behaviors that reflect our core values:

- Integrity - We are honest in our interactions to foster trust, accountability, and responsibility.

- Empowerment - We are committed to providing the resources necessary to elevate our employees & our business to excellence.

- Sustainability - We are dedicated to the wellbeing of our communities, our people, our environment and to the long-term success of our business.

- Compassion - We are inspired to help others and committed to a workplace of kindness, understanding, and respecting others’ diverse perspectives and experiences.

SUMMARY

The Senior Data Engineer builds the data foundation that Schupan runs on. You’ll design and operate pipelines in Databricks, our primary data platform, connect our operational systems, and use AI tools like Claude and Replit to turn data into tools and answers our teams actually use. This is a hands-on role for someone who wants to solve real business problems, not just maintain infrastructure.

WHY YOU’LL WANT THIS JOB

- Your work shows up fast - You’ll be part of a small team at a roughly 600-person company. There’s no layer of committees between what you build and the people who use it, so you’ll see your pipelines and integrations change how our trading, recycling, and operations teams make decisions.

- You’ll build with modern tools - We run on Databricks and are rolling out AI tools, including Claude, across the company. You’ll be expected to use them in your own work and help the business put them to use, not wait for permission.

- The data connects to the physical world - Our data describes trucks, yards, loads, and tons of metal moving through the economy. The problems are concrete, and solving them has a visible effect on the business.

- You’ll shape the architecture, not inherit it - We’re setting our integration and data standards now. You’ll help decide how they’re built rather than maintain someone else’s decisions.

- A company built for the long term - Schupan is a multi-generational family business. We make decisions on a long horizon and invest in the people who build with us.

ESSENTIAL FUNCTIONS

- Data Platform : Design, build, and maintain pipelines and data models in Databricks, our primary data platform. Monitor their performance, reliability, and cost.

- Systems Integration : Connect our operational systems, including SQL Server–based systems of record, to Databricks and to each other through APIs and integration tools. Monitor, troubleshoot, and improve existing integrations.

- Build with AI : Use Claude and Replit to build and ship tools, automations, and internal apps quickly, and help colleagues across the business do the same.

- Solve Business Problems : Work directly with our trading, recycling, and operations teams. Go see the work, define the real question, and deliver data solutions people use to make decisions.

- Data Quality : Implement validation and monitoring so data stays accurate, consistent, and trusted across relational, column-oriented, and unstructured sources.

- Security Compliance : Follow security practices and comply with regulatory standards and company policies, including access and permissions standards.

- Communication : Translate business needs into technical requirements, and explain technical choices clearly to senior leadership and non-technical colleagues.

- Must be able to interact in person with coworkers.

- Perform other duties as assigned.

REASONABLE ACCOMMODATIONS STATEMENT

To accomplish this job successfully, an individual must be able to perform, with or without reasonable accommodation, each essential function satisfactorily. Reasonable accommodations may be made to help enable qualified individuals with disabilities to perform the essential functions.

Qualifications

POSITION QUALIFICATIONS

EDUCATION AND EXPERIENCE

- Bachelor’s degree in computer science, information systems, data engineering, applied mathematics, or a similar field (preferred)

- Minimum of 5 years of experience as a Data Engineer, API Developer, or similar role.

SKILLS AND ABILITIES

- Hands-on experience building and operating data pipelines in Databricks (Spark, SQL, Delta Lake).

- Strong SQL skills, including T-SQL and Microsoft SQL Server.

- Intermediate or expert proficiency in Python.

- Experience designing and consuming APIs (REST; GraphQL a plus) and working with integration platforms.

- Demonstrated, hands-on use of Claude and Replit, or comparable AI coding and app-building tools, in your own work. Be ready to show us something you built.

- Experience integrating cloud services with on-premises systems; Azure Data Factory and SSIS experience a plus.

- A track record of teaching yourself new tools and putting them to work quickly.

PHYSICAL REQUIREMENTS

- Frequently lift and/or move IT equipment weighing up to 25 pounds and occasionally lift and/or move equipment up to 50 pounds

- Prolonged periods sitting at a desk and working on a computer

The company has reviewed this job description to ensure that essential functions and basic duties have been included. It is intended to provide guidelines for job expectations and the employee's ability to perform the position described. It is not intended to be construed as an exhaustive list of all functions, responsibilities, skills and abilities. Additional functions and requirements may be assigned by supervisors as deemed appropriate. This document does not represent a contract of employment, and the company reserves the right to change this job description and/or assign tasks for the employee to perform, as the company may deem appropriate.