Senior Data Engineer

Task

Lead the design and implementation of scalable data pipelines and Lakehouse architecturesAct as the design authoritySolve the hardest technical challenges including optimizing high-load streaming pipelines, debugging complex Spark jobs, and designing generic frameworksParticipate in technical assessments, audits of existing systems, and proposal estimationsExplain the ROI of technical modernizationEnsure all solutions are production-ready including security, monitoring, cost-efficiency, and documentationDefine coding standardsConduct code reviewsMentor Middle and Junior engineers to foster a culture of engineering excellence

Expectation

Expertise in Python or Scala including design patterns and library developmentExpert-level SQL knowledge including internalsProficiency with Databricks (Unity Catalog), Snowflake, BigQuery, SynapseDeep knowledge of Spark/PySpark including internals, tuning, and streamingExperience with dbt enterprise patternsFamiliarity with architecture patterns such as Data Mesh, Lakehouse (Delta Lake/Iceberg), Lambda/KappaAdvanced skills in Terraform/IaC, CI/CD, Docker, KubernetesExpert-level knowledge of AWS, GCP, or Azure including networking (VPC, PrivateLink), security (IAM), and integration limitsExperience in presales, technical audits, or discovery phasesAbility to translate business needs into technical specificationsUnderstanding of engineering data for Machine Learning including feature engineering and pipelines for LLM/RAG

Other

Deep experience with Kafka, Kinesis, or Spark Structured StreamingExperience with Vector Databases such as Pinecone, pgvector, Weaviate or frameworks like LangChainProfessional-level cloud certifications such as AWS Solutions Architect Pro, Databricks Certified DE ProfessionalAdvanced modeling for DynamoDB, Cosmos DB, or MongoDB

What we offer

Competitive compensation packagesStable employment based on a full-time employment contractMentoring program and professional development planPrivate health insurance (Medicare Clinic)AYCM sport pass providing discounts at various sports facilities in HungaryInteresting tasks and diverse opportunities for developing skillsFree training coursesParticipation in internal and external thematic events and technical conferencesA spacious office in the heart of Budapest (13th district)All necessary devices and tools for workFriendly, motivating atmosphereActive corporate life

Company details:

NIX is a global supplier of software engineering and IT outsourcing services. NIX teams collaborate with partners from different countries. Our specialists have experience in developing innovative projects from ecommerce to cloud for some of the largest companies in the world, including from the Fortune 500. The teams are focused on stable development of the international IT market, business, and their own professional skills.