Sr Data Engineer

Overview

Baker Tilly is a leading advisory, tax and assurance firm, providing clients with a genuine coast-to-coast and global advantage in major regions of the U.S. and in many of the world’s leading financial centers – New York, London, San Francisco, Los Angeles, Chicago and Boston. Baker Tilly Advisory Group, LP and Baker Tilly US, LLP (Baker Tilly) provide professional services through an alternative practice structure in accordance with the AICPA Code of Professional Conduct and applicable laws, regulations and professional standards. Baker Tilly US, LLP is a licensed independent CPA firm that provides attest services to its clients. Baker Tilly Advisory Group, LP and its subsidiary entities provide tax and business advisory services to their clients. Baker Tilly Advisory Group, LP and its subsidiary entities are not licensed CPA firms.

Baker Tilly Advisory Group, LP and Baker Tilly US, LLP, trading as Baker Tilly, are independent members of Baker Tilly International, a worldwide network of independent accounting and business advisory firms in 141 territories, with 43,000 professionals and a combined worldwide revenue of $5.2 billion. Visit bakertilly.com or join the conversation on LinkedIn, Facebook and Instagram.

Please discuss the work location status with your Baker Tilly talent acquisition professional to understand the requirements for an opportunity you are exploring.

Baker Tilly is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability or protected veteran status, gender identity, sexual orientation, or any other legally protected basis, in accordance with applicable federal, state or local law.

Any unsolicited resumes submitted through our website or to Baker Tilly Advisory Group, LP, employee e-mail accounts are considered property of Baker Tilly Advisory Group, LP, and are not subject to payment of agency fees. In order to be an authorized recruitment agency ("search firm") for Baker Tilly Advisory Group, LP, there must be a formal written agreement in place and the agency must be invited, by Baker Tilly's Talent Attraction team, to submit candidates for review via our applicant tracking system.

Job Description

Baker Tilly is seeking a Sr Data Engineer to join the founding team of the firm's AI Product Group (APG). This hands-on engineering role is responsible for building scalable, secure, and reliable data infrastructure that powers the firm's AI applications and intelligent agents. The position focuses on two critical areas: developing a governed data foundation that transforms enterprise information and client documents into high-quality, traceable data products, and building the knowledge layer that enables AI agents to retrieve, interpret, and use information accurately. This includes developing production data pipelines, implementing data models and governance controls, and supporting advanced capabilities such as knowledge graphs, enterprise search, and retrieval.

As an early member of the AI Product Group, this individual will collaborate closely with data platform leadership, AI engineers, enterprise architects, business practitioners, and globally distributed technical teams to deliver production-ready data solutions. The role emphasizes strong data engineering fundamentals, hands-on development, data quality, and evaluation-driven engineering practices. The ideal candidate brings demonstrated experience building and operating modern lakehouse pipelines, strong Python and SQL skills, and the ability to develop reliable, maintainable solutions in a fast-paced environment. Prior experience with AI, machine learning, or knowledge graphs is not required; success in this role depends on sound engineering judgment, analytical thinking, and the ability to learn and apply emerging technologies.

Key Responsibilities

• Design and Build Data Pipelines: Develop, implement, and maintain scalable batch and incremental data pipelines that transform structured and unstructured information into clean, validated, business-ready datasets within a modern lakehouse environment.

• Develop and Maintain Lakehouse Architecture: Build and optimize data processing and transformation layers using modern lakehouse principles, including medallion architecture, data modeling, and integration of enterprise and legacy data sources.

• Ensure Data Quality, Lineage, and Provenance: Implement automated validation, reconciliation, lineage tracking, and metadata management to ensure data accuracy, consistency, traceability, and reliability throughout the data lifecycle.

• Build Data Models and Identity Resolution Capabilities: Develop scalable data models, data contracts, and entity-resolution processes that establish consistent client, engagement, and document identities across enterprise data sources.

• Implement Data Governance and Access Controls: Support data cataloging, classification, permissions, and access management to ensure sensitive information is appropriately governed and accessible only to authorized users and AI agents.

• Develop Knowledge Graph and Retrieval Capabilities: Build and maintain knowledge graph structures, data relationships, search indexes, and retrieval pipelines that enable AI applications to access relevant, accurate, and properly governed enterprise information.

• Support AI Data Readiness and Continuous Learning: Develop pipelines that capture AI agent activity, practitioner feedback, reviews, and corrections to support ground-truth datasets, AI evaluation, and ongoing improvements in data and retrieval quality.

• Drive Evaluation-Based Data Engineering: Establish measurable quality standards, testing frameworks, benchmarks, and validation processes to assess data extraction, retrieval effectiveness, and grounding accuracy.

• Maintain Data Freshness and Reliability: Implement incremental processing, change data capture, versioning, and monitoring capabilities to ensure data products, knowledge graphs, and search indexes remain accurate and current as source systems evolve.

• Own Production Delivery and Operational Support: Deploy, monitor, troubleshoot, and maintain production data pipelines, applying strong engineering practices, automated testing, code reviews, and operational documentation.

• Support Knowledge Transfer and Technical Ownership: Collaborate with external engineering partners to transition data solutions into internally owned, documented, and maintainable production environments, including the development of reusable code, tests, and runbooks.

• Collaborate Across Global and Cross-Functional Teams: Partner with AI Engineering, Platform & Production Engineering, enterprise data teams, subject matter experts, and engineering teams in India to align technical solutions with enterprise standards and business objectives.

• Support Strategic Initiatives: Participate in special projects and perform other duties as assigned to advance the firm's AI and data platform capabilities.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field; advanced degree preferred.

• 3 years of hands-on data engineering or software engineering experience, including demonstrated success developing, deploying, and maintaining production data pipelines.

• Required experience independently building and operating production pipelines on a modern lakehouse platform, with demonstrated ownership of data processing, transformation, and operational reliability.

• Required experience implementing data quality, lineage, or data contracts within production pipelines, including automated testing, reconciliation, validation, or traceability practices.

• Strong proficiency in Python and SQL, with demonstrated ability to develop, optimize, test, and maintain production-quality data engineering solutions.

• Strong understanding of data modeling