{"id":3948132,"url":"https://alion.io/job/devtalents-senior-data-engineer","title":"Senior Data Engineer","company":{"id":4474048,"name":"Devtalents","domain":"devtalents.com","url":"https://alion.io/company/devtalents","size_band":"11-50","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Recruitee","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Warsaw, Poland"],"countries":["PL"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":25000,"max":32000,"currency":"PLN","period":"month","gross":null,"usd_annual":97476},"salary_estimate":null,"experience_years_min":6,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Ansible","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"AWS Glue","optional":false},{"name":"CI/CD","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Slack","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false},{"name":"Amazon CloudWatch","optional":true},{"name":"Amazon Kinesis","optional":true},{"name":"Amazon S3","optional":true},{"name":"AWS Lambda","optional":true},{"name":"FastAPI","optional":true},{"name":"GraphQL","optional":true},{"name":"Rest API","optional":true},{"name":"Spark","optional":true}],"status":"live","first_seen_at":"2024-12-16T13:37:16Z","employer_posted_date":"2024-12-16","last_verified_at":"2026-11-08T23:17:47Z","board_verified":true,"closed_at":null,"days_open":692,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":692},"description":"About us:\n\nWe are looking for a Senior Data Engineer to be a part of the DEVTALENTS team and contribute to the development of truly amazing solutions for businesses all over the world.\nJoining DEVTALENTS can be a life-changing decision for you, with endless benefits along the way. We provide top projects for which recruitment is not possible externally because of our wide range of partners. We value open and transparent communication, leveraging tools like Slack and generative AI to enhance collaboration and efficiency. We support continuous growth, encouraging you to step beyond your comfort zone and develop technically and personally. We are looking for an experienced Senior Data Engineer to join our team and provide technical leadership and mentorship.\nYour Role:\nLead the design, development, and maintenance of data pipelines and ETL/ELT processes to handle large-scale, diverse datasets.\n\nOptimize data ingestion, transformation, and delivery using SQL, PySpark, and Python.\n\nLeverage frameworks like Apache Airflow, AWS Glue, Kafka, and Redshift to ensure efficient data orchestration, batch/stream processing, and high-performance analytics.\n\nDrive best practices in version control (Git), infrastructure as code (Terraform, Ansible), and CI/CD pipelines to ensure robust, repeatable, and scalable deployments.\n\nCollaborate closely with cross-functional teams-Data Scientists, Analysts, Product Managers-to design data models and architectures that meet business objectives.\n\nMonitor, debug, and optimize ETL pipelines, ensuring high reliability, low latency, and cost efficiency.\n\nMentor mid-level and junior engineers, fostering a culture of knowledge sharing, continuous improvement, and innovation.\n\nRequirements\n\n Technical Expertise:\nStrong proficiency in SQL, PySpark, and Python for data transformations and scalable pipeline development (6+ years of commercial experience).\n\nHands-on experience with Apache Airflow, AWS Glue, Kafka, and Redshift. Familiarity with handling large volumes of structured and semi-structured data. Experience with DBT is a bonus.\n\nProficiency with Git for version control. Airflow is crucial for orchestration.\n\nSolid experience working with AWS (Lambda, S3, CloudWatch, SNS/SQS, Kinesis) and exposure to serverless architectures.\n\nExperience with Terraform and Ansible to automate and manage infrastructure.\n\nStrong skills in monitoring ETL pipelines, troubleshooting performance bottlenecks, and maintaining high operational reliability.\n\nFamiliarity with CI/CD processes to automate testing, deployment, and versioning of data pipelines.\n\nAbility to design distributed systems that scale horizontally for large data volumes. Knowledge of real-time (Lambda) and batch (Kappa) processing architectures is a plus.\n\nExperience building APIs (REST, GraphQL, OpenAPI, FastAPI) for data exchange.\n\nExposure to Data Mesh principles and self-service data tools is highly desirable. Previous experience in building scalable data platforms and transforming large datasets is a strong plus.\n\nHigher education with a profile in Computer Science or related\n\nEnglish level min. B2.\n\nMindset & Approach:\nA problem-solving attitude, with a passion for data-driven decision-making and continuous improvement.\n\nStrong communication skills, capable of translating complex data engineering concepts into understandable terms for technical and non-technical stakeholders.\n\nA collaborative spirit, thriving in cross-functional, agile environments, and eager to mentor and guide team members.\n\nA desire to stay ahead of industry trends, experiment with new technologies, and drive innovation in data engineering practices.\n\nWhat We Offer:\nInfluence over data architecture and platform decisions, playing a key role in shaping our data strategy.\n\nA transparent, supportive culture that fosters professional growth, learning, and innovation.\n\nOngoing opportunities for training, workshops, and engagement with the broader data engineering community.","description_format":"text","description_chars":3982,"description_truncated":false,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"Upper-Intermediate (B2)","optional":false}]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Staffing & Staff Augmentation"],"lifecycle":[{"event":"open","at":"2026-11-08T23:17:47Z"}],"visa":[],"liveness":{"score":8,"band":"cold","label":"Long shot","p_open":1,"p_active":0.271,"p_room":0.28,"age_days":692,"expected_fill_days":32,"reasons":["conf:1","win:tail","crowd:"],"computed_at":"2026-11-09T00:37:46Z"},"pay":{"stated_usd_annual":97476,"is_top_pay":false},"html_url":"https://alion.io/job/devtalents-senior-data-engineer","json_url":"https://alion.io/job/devtalents-senior-data-engineer.json","meta":{"generated_at":"2026-11-09T00:37:46Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":1344,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-10T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4474048},"rest":"https://alion.io/mcp/rest/get_company?id=4474048"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fdevtalents-senior-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fdevtalents-senior-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fdevtalents-senior-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/devtalents-senior-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fdevtalents-senior-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3948132}},{"tool":"search_jobs","arguments":{"company":"devtalents.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3948132},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}