Senior Data and AI Engineer - Finance
Role overview
As a Finance Data and AI Specialist, you will be a hands-on contributor building and maintaining the data pipelines, applications, and AI-powered tools that support Databricks' Finance and Accounting organisation. This is part of the Finance org. You will report to the Senior Manager, Finance Data and AI and work as a core member of a team that combines engineering rigour with Finance domain knowledge.
This role is ideal for someone who is technically strong, eager to go deep on the Databricks Platform, and excited to apply modern data and AI tooling to real Finance problems.
Responsibilities
- check_circle Build and maintain finance data pipelines in the Finance DataLake using Databricks Jobs and Lakeflow Lakeflow Spark Declarative Pipelines, including data validation and reconciliation logic
- check_circle Develop and iterate on AI-assisted tools for the Finance and Accounting organisation, including automation of manual workflows, anomaly detection, and reporting enhancements
- check_circle Contribute to the development of Finance applications (Databricks Apps, Genie Spaces, dashboards) that enable self-service analytics for Finance stakeholders
- check_circle Build and maintain reports and dashboards for monthly, quarterly, and executive-level reporting
- check_circle Support the implementation of row-level security and data access policies across Finance DataLake datasets
- check_circle Work with Accounting, FP&A, Internal Audit, and Procurement teams to gather requirements and deliver well-documented technical solutions
- check_circle Follow Git-based version control, pull-request review processes, and CI/CD pipelines (Declarative Automation Bundles, GitHub Actions) to meet SOX change management requirements
- check_circle Support financial close by monitoring pipelines, investigating data issues, and escalating as needed
- check_circle Participate in UAT for new system integrations and assist with technical documentation
- check_circle Contribute to team coding standards and data modelling conventions under the guidance of the Finance Data Lead
- check_circle 7+ years of experience in data engineering, analytics engineering, or finance systems
- check_circle Proficiency in SQL and Python for pipeline development; hands-on experience with Apache Spark or the Databricks platform is a strong plus
- check_circle Experience connecting to and ingesting from financial source systems (NetSuite, Salesforce, Stripe, Zuora, or similar)
- check_circle Working knowledge of finance and accounting concepts, including close processes, revenue recognition, and financial reporting
- check_circle Ability to translate Finance requirements into clean, maintainable technical solutions with guidance
- check_circle Comfortable communicating across technical and non-technical audiences
- check_circle Experience contributing to BI dashboards and self-service data products
- check_circle Curiosity about AI/ML and interest in applying new techniques to Finance workflows
Preferred qualifications
- Prior experience at a high-growth SaaS or cloud infrastructure company
- Exposure to AI/BI tools, Genie, or LLM-powered applications
Tags & Focus Areas
About Databricks
Note: The job is a remote job and is open to candidates in USA. Databricks is the data and AI company, and they are seeking a highly skilled Lead Security Architect to join their IT team. This role involves designing and implementing secure architectures to protect corporate assets while focusing on IT security areas such as Identity and Access Management and Zero Trust architecture.
Ready to Join the Team?
Apply once with DevFound — we route your profile to Databricks and keep you posted on matching AI roles.