{"id":1806138,"url":"https://alion.io/job/vertextech-eg-senior-data-engineer","title":"Senior Data Engineer","company":{"id":3882190,"name":"Vertex Technologies","domain":"vertextech-eg.com","url":"https://alion.io/company/vertextech-eg","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Cairo, Egypt"],"countries":["EG"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":56000,"max_usd":145000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":2127},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon Kinesis","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Apache Kafka","optional":false},{"name":"CI/CD","optional":false},{"name":"Data Vault","optional":false},{"name":"Databricks","optional":false},{"name":"Docker","optional":false},{"name":"Feature Store","optional":false},{"name":"Flink","optional":false},{"name":"IAM","optional":false},{"name":"Kubernetes","optional":false},{"name":"LLM","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false},{"name":"AWS","optional":true},{"name":"AWS Lambda","optional":true},{"name":"Azure Cosmos DB","optional":true},{"name":"BigQuery","optional":true},{"name":"dbt","optional":true},{"name":"DynamoDB","optional":true},{"name":"Google BigQuery","optional":true},{"name":"LangChain","optional":true},{"name":"pgvector","optional":true},{"name":"Pinecone","optional":true},{"name":"PostgreSQL","optional":true},{"name":"Weaviate","optional":true}],"status":"live","first_seen_at":"2026-09-14T16:45:43Z","employer_posted_date":null,"last_verified_at":"2026-09-14T16:45:43Z","board_verified":false,"closed_at":null,"days_open":27,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":27},"description":"Role SummaryYou are the technical authority on client projects. You design solutions from the ground up, review and improve existing systems, define architectures, estimate delivery efforts, and guide teams through successful implementation.\nClient technologies will vary, but strong technical judgment remains constant. You know when the simplest solution is the right one. You understand the discipline of data engineering, not just the tools used to implement it.\n\nThe Mission\nBuild platforms that scale with the business, pass audits, and stay reliable, even at 3 a.m. Enable teams to become stronger after every engagement.\n\nThe Tech Stack\nCore Languages: Python (patterns, library design), SQL (internals).\n\nPlatforms: Databricks (Unity Catalog), Snowflake, BigQuery, Synapse.\n\nProcessing & Streaming: Spark (internals, tuning), Kafka / Structured Streaming, dbt (enterprise patterns).\n\nArchitecture: Lakehouse (Delta/Iceberg), Data Mesh, Lambda/Kappa.\n\nGovernance & Quality: catalogs, lineage, RBAC/masking, data contracts, observability.\n\nInfrastructure & DevOps: advanced Terraform, CI/CD, Docker/Kubernetes.\n\nEmerging: feature stores, vector databases, LLM/RAG data pipelines.\n\nYour Responsibilities\nOwn architecture on engagements; act as the Design Authority.\n\nSolve the hardest problems: streaming under load, Spark debugging, framework design.\n\nDrive presales: assessments, audits, estimations; explain the ROI of modernization.\n\nMake solutions production-ready: secure, observable, cost-efficient, documented - with quality SLAs defined.\n\nSet standards, review code, grow Middle and Junior engineers.\n\nWhat We Offer\nLong-term career stability with a competitive salary paid in USD.\n\nConditions for steady career development.\n\nDevelopment supported by dedicated mentors and a variety of programs focused on expertise and innovation.\n\nPrivate medical insurance provided after successful completion of the probationary period\n\nA well-equipped and cozy office supports comfort and productivity across all project stages.\n\nWelcoming atmosphere and a friendly corporate culture.\n\nRequirements\nYour Skills\nExperience: 5+ years of data engineering, with delivery you owned end to end.\n\nEngineering Mastery: expert Python and SQL; you optimize code others wrote.\n\nCraft Fluency: the discipline's concepts explained clearly enough to teach: modeling methodologies (Kimball, Data Vault), processing paradigms, consistency and delivery guarantees.\n\nPlatform Depth: Databricks (Spark memory, partitioning) or Snowflake (warehouse tuning, RBAC, zero-copy cloning) - how they work under the hood.\n\nStreaming: production experience with Kafka or Kinesis plus Spark Structured Streaming or Flink.\n\nGovernance: design access models, lineage, and quality SLAs a client can pass an audit with.\n\nArchitectural Vision: end-to-end design, tool selection with trade-offs (\"Why Snowflake over Redshift?\"), decisions defended to leadership.\n\nCloud Mastery: one major cloud at expert level - networking (VPC, PrivateLink), security (IAM), service limits.\n\nConsulting: presales, technical audits, discovery; business needs into technical specs.\n\nAI/ML Readiness: feature engineering, data pipelines for LLM/RAG.\n\nNice to Have\nGenAI Stack: vector databases (Pinecone, pgvector, Weaviate), LangChain-style frameworks.\n\nStreaming Depth: Flink or Kafka Streams in production.\n\nCertifications: professional level (AWS Solutions Architect Pro, Databricks DE Professional).\n\nNoSQL: advanced modeling for DynamoDB, Cosmos DB, or MongoDB.","description_format":"text","description_chars":3516,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Health insurance"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-03T19:02:00Z"}],"visa":[],"liveness":{"score":63,"band":"ok","label":"Likely open","p_open":0.85,"p_active":0.825,"p_room":0.9,"age_days":25,"expected_fill_days":47,"reasons":["seen:25","velocity","win:mid"],"computed_at":"2026-10-10T05:45:15Z"},"pay":null,"html_url":"https://alion.io/job/vertextech-eg-senior-data-engineer","json_url":"https://alion.io/job/vertextech-eg-senior-data-engineer.json","meta":{"generated_at":"2026-10-11T23:47:48Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":15043,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-12T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3882190},"rest":"https://alion.io/mcp/rest/get_company?id=3882190"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fvertextech-eg-senior-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fvertextech-eg-senior-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fvertextech-eg-senior-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/vertextech-eg-senior-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fvertextech-eg-senior-data-engineer"}]}