Full-Stack Data Engineer II

A new regulatory change lands somewhere in the world every six minutes and agentic AI is outpacing most teams ability to govern it. At Archer we help the enterprises powering the global economy turn that pressure into an advantage.â

Mandates like the EU AI Act and the SEC cybersecurity disclosure rules are driving the most significant GRC buying cycle we have seen in years. That demand is why we areâgrowingâthis team.â

This isâhard workâthat matters. Our customers span energy utilities financial services pharmaceuticals and the public institutions communities depend on. People choose Archer because they get to partner with the most trusted brands in the world on work that protects the customers and communities those brands serve.â

If that sounds like your kind of workâletsâchat.â

We are looking for a forward-thinking Full-Stack Data Engineer II to join our team in Egypt. This is not a traditional ETL role; you will be at the forefront of the Data AI era leveraging DataBricks to build intelligent data products. You will be responsible for the end-to-end lifecycle of data from ingestion and Lakehouse architecture to developing agentic AI workflows that allow our business systems to act autonomously based on data insights.

AI & Agentic Focus

Build and deploy LLM-based agents that utilize data tools to solve complex tasks including implementing Retrieval-Augmented Generation (RAG) patterns and autonomous chains-of-thought for decision-making.

Stack: DataBricks & Agentic AI

• Design and optimize Delta Lake tables within DataBricks using Unity Catalog for governance.
• Develop and deploy agentic workflows using LangChain AutoGen or DataBricks Mosaic AI.
• Build Python-based backend services (FastAPI) to expose AI-driven insights.
• Manage data pipelines using DataBricks Workflows and Delta Live Tables (DLT).
• Implement monitoring frameworks to ensure agent accuracy safety and performance.

• 24 years experience with PySpark and SQL
• Strong experience with DataBricks (Unity Catalog DLT Notebooks)
• Understanding of Lakehouse architecture
• Hands-on experience with LLMs and prompt engineering
• Experience building AI agents using APIs and tools
• Backend development in Python and Docker

• MLflow for model tracking and deployment
• Vector databases (Pinecone Weaviate DataBricks Vector Search)
• Familiarity with Egyptian data localization requirements

Please note this job description is not designed to cover or contain a comprehensive listing of activities duties or responsibilities that are required of the employee for this job. Duties responsibilities and activities may change at any time with or without notice at management discretion based on business need.

Archer is committed to the principle of equal employment opportunity for all employees and applicants for employment and to providing employees with a work environment free of discrimination and harassment. All employment decisions at Archer are based on business needs job requirements and individual qualifications without regard to race color religion national origin sex (including pregnancy) age disability sexual orientation gender identity and/or expression marital civil union or domestic partnership status protected veteran status genetic information or any other characteristic protected by federal state or local laws. Archer will not tolerate discrimination or harassment based on any of these characteristics. This policy applies to all terms and conditions of employment including recruiting hiring placement promotion termination layoff recall transfer leaves of absence compensation and training. All Archer employees are expected to support this policy and contribute to an environment of equal opportunity.

If you need a reasonable accommodation during the application process please contact. All employees must be legally authorized to work in the country they are applying for. Archer and its approved consultants will never ask you for a fee to process or consider your application for a career with Archer. Archer reserves the right to amend or withdraw any job posting at any time including prior to the advertised closing date.

Please contact our Talent Acquisition team atfor the range and related compensation details. Actual pay may vary based on location experience skills and internal equity.

Required Experience:

IC