• Companies
  • News
By technology
  • Python17.1k
  • AWS12k
  • Kubernetes8.7k
  • Docker8.3k
  • C++5.7k
  • PostgreSQL5.4k
  • SQL5.2k
By category
  • Backend Developer11.5k
  • DevOps Engineer3.4k
  • Machine Learning Engineer3.3k
  • Full Stack Developer3.2k
  • Data Engineer2.8k
  • Embedded Engineer2.2k
  • Frontend Developer862
By city
  • San Francisco, CA6.2k
  • New York, NY5.6k
  • Seattle, WA1.3k
  • Washington, DC1.2k
  • Toronto, ON1.2k
  • Boston, MA1k
  • Austin, TX999
Work mode
  • On-site22k
  • Remote10.2k
  • Hybrid7.3k
Job type
  • Full-time38.2k
  • Contract600
  • Part-time529
  • Freelance215
  • internship4
  • seasonal1
Experience
  • Entry level
  • Mid level
  • Senior
  • Staff+
  • Engineering management

The job board for developers. Find your next role at companies that value great engineering.

© 2023-2026 . All rights reserved.

Logos provided by Logo.dev
All jobs

Data Operations Technical Lead

Agile Defense · Tampa, FL

Extracted from the posting

Base
Not stated
Remote
General office environment, MacDill AFB, FL
Stack
Apache Kafka, Apache Flink, Spark

Technical lead responsible for SOF Enterprise data infrastructure, including ETL/ELT pipelines, real-time streaming with Kafka, Flink, or Spark Streaming, and data models. Owns data quality, validation, and monitoring, and mentors junior data engineers. Stack includes data warehouses, data lakes, and workflow automation.

About Agile Defense

At Agile Defense we know that action defines the outcome and new challenges require new solutions. That’s why we always look to the future and embrace change with an unmovable spirit and the courage to build for what comes next.

Our vision is to bring adaptive innovation to support our nation's most important missions through the seamless integration of advanced technologies, elite minds, and unparalleled agility—leveraging a foundation of speed, flexibility, and ingenuity to strengthen and protect our nation’s vital interests.


Requisition #: 

1700

Job Title:

Data Operations Technical Lead

Location:

MacDill AFB, FL

Clearance Level:

Top Secret / SCI, Must Have Clearance to Start

Job Description

  • Design, build, and maintain highly scalable, reliable, and efficient data pipelines for extracting, transforming, and loading (ETL/ELT) data from various sources into data warehouses, data lakes, and other storage systems.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure the efficient flow of data across various platforms and systems. 
  • Develop, deploy, and maintain real-time data streaming solutions to process and deliver data with low latency (using tools like Apache Kafka, Flink, or Spark Streaming). Optimize and automate data workflows, ensuring that data pipelines are efficient, reliable, and capable of handling increasing data volumes. Oversee the development of data models and schema designs to ensure accurate, accessible, and high-performance data storage for analytics and reporting.
  • Ensure data quality, integrity, and consistency by implementing data validation, monitoring, and error-handling mechanisms.
  • Monitor and troubleshoot performance bottlenecks in data systems, resolving issues with data processing and data access. 
  • Stay current with emerging trends and best practices in data engineering, recommending new tools, technologies, and methods to enhance existing infrastructure.
  • Mentor and guide junior data engineers, promoting best practices in data engineering and fostering a collaborative, high-performance team environment.

Education and Background

    Years of Experience

      Required Skills

      • Have active active TS/SCI clearance
      • Minimum of eight years’ experience managing digital projects in support of SOF Enteprise customers

      Preferred Skills

      • Three years experience managing SOF agile development processes
      • Three years experience managing SOF Data Operations processes and procedures
      • Three years experience managing SOF digital support request requirements, translating them from customer requests to assigning customer and digital support teams

      Working Conditions

        Our Core Values

        Employees of Agile Defense are our number one priority, and the importance we place on our culture here is fundamental. Our culture is alive and evolving, but it always stays true to its roots. Here, you are valued as a family member, and we believe that we can accomplish great things together. Agile Defense has been highly successful in the past few years due to our employees and the culture we create together.

        What makes us Agile? We call it the 6Hs, the values that define our culture and guide everything we do. Together, these values infuse vibrancy, integrity, and a tireless work ethic into advancing the most important national security and critical civilian missions. It's how we show up every day. It's who we are.

        • Happy - Be Infectious. Happiness multiplies and creates a positive and connected environment where motivation and satisfaction have an outsized effect on everything we do.
        • Helpful - Be Supportive. Being helpful is the foundation of teamwork, resulting in a supportive atmosphere where collaboration flourishes, and collective success is celebrated.
        • Honest - Be Trustworthy. Honesty serves as our compass, ensuring transparent communication and ethical conduct, essential to who we are and the complex domains we support.
        • Humble - Be Grounded. Success is not achieved alone, humility ensures a culture of mutual respect, encouraging open communication, and a willingness to learn from one another and take on any task.
        • Hungry - Be Eager. Our hunger for excellence drives an insatiable appetite for innovation and continuous improvement, propelling us forward in the face of new and unprecedented challenges.
        • Hustle - Be Driven. Hustle is reflected in our relentless work ethic, where we are each committed to going above and beyond to advance the mission and achieve success.

        Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities

        Technologies

        Apache KafkaApache FlinkSpark
        Agile Defense
        Agile Defense

        Job details

        TypeFull-time
        Work ModeOn-site
        LevelLead
        Location🇺🇸Tampa, FL
        PostedNov 06, 2026
        Apply Now

        Related jobs

        Twilio

        Staff, Software Engineer (L4)

        Twilio
        Remote - IndiaRemote · Full-timeGo · Java · Scala
        Instructure, Inc.

        Senior Analytics Engineer

        Instructure, Inc.
        $145,000 - $155,000US-REMOTERemote · Full-timedbt · Snowflake · SQL
        Solution Design Group

        Data Engineer

        Solution Design Group
        $120,000 - $140,000🇺🇸 Minneapolis, MNHybrid · Full-timeSQL Server · PostgreSQL · MySQL