Preferred Qualifications:

• Databricks certification such as Data Engineer Associate or Professional.
• Experience standing up or maturing Unity Catalog structures and access models in an enterprise setting.
• Experience with CI/CD, infrastructure-as-code, and deployment automation for data platforms.
• Experience in defense, aerospace, financial services, healthcare, or another highly regulated environment.
• Experience enabling multiple business domains on a shared data platform while maintaining strong governance and ownership boundaries.

Required Qualifications:

• 12+ years of data engineering experience, including hands-on ownership of production data pipelines.
• Strong Databricks experience, including Delta Lake, Databricks Workflows or Jobs, and Spark with PySpark and/or Spark SQL.
• Working knowledge of Unity Catalog, including catalogs, schemas, tables, lineage, and access control concepts.
• Experience with batch, CDC, and/or streaming ingestion patterns and the operational trade-offs associated with each.
• Experience with CI/CD and deployment automation for data pipelines and platform assets, including version control, testing, and controlled promotion across environments.
• Strong SQL skills and solid grounding in data modeling fundamentals, even if dimensional modeling is not the primary responsibility of this role.
• Demonstrated ability to understand the business and regulatory context of the data being processed, not just the mechanics of pipeline development.
• Experience applying data classification, segregation, security, retention, or compliance requirements in data engineering workflows within a regulated or security-sensitive environment.
• Ability to design pipelines with awareness of the actual data domains involved, including sensitivity, ownership, permitted use, and downstream impact.
• Comfort operating in a fast-moving platform build where patterns are still being established and engineers are expected to shape standards, not just follow them.

#LI-KE1

#LE

Full-time regular employee offer package:

Pay within range listed + Bonus + Benefits + Equity

Temporary employee offer package:

Pay within range listed above + temporary benefits package (applicable after 60 days of employment)

Salary compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location. All offers are contingent on a cleared background and possible reference check. Military fellows and part-time employees are not eligible for benefits. Please speak to your talent acquisition representative for more information.

###

Shield AI is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please let us know.

Compensation: USD 145,000 – 220,000 per year salary