{"id":4716073,"url":"https://alion.io/job/software-finder-data-engineer","title":"Data Engineer","company":{"id":1796337,"name":"Software Finder","domain":"softwarefinder.com","url":"https://alion.io/company/softwarefinder","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Teamtailor","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"junior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Lahore, Pakistan"],"countries":["PK"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":2,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Amazon EventBridge","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Amazon S3","optional":false},{"name":"AWS","optional":false},{"name":"AWS Glue","optional":false},{"name":"AWS Lambda","optional":false},{"name":"AWS Step Functions","optional":false},{"name":"CI/CD","optional":false},{"name":"Claude Code","optional":false},{"name":"dbt","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"GitHub Actions","optional":false},{"name":"Python","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false}],"status":"live","first_seen_at":"2026-08-04T14:17:02Z","employer_posted_date":"2026-08-04","last_verified_at":"2026-11-21T17:14:58Z","board_verified":true,"closed_at":null,"days_open":109,"trust":{"level":"stale","repost_count":0,"flags":["stale"],"days_open":108},"description":"Data Engineer\nSoftware Finder is seeking skilled and motivated Data Engineers to join its growing Data Engineering team. This AWS-focused role involves building and managing data pipelines end to end, from ingestion and transformation to delivering reliable datasets that support business intelligence, analytics, and strategic decision-making.\nThe ideal candidate will have strong SQL and Python skills, practical experience with AWS data services, and a solid understanding of data modeling and workflow orchestration. The data products developed in this role will support revenue-generating systems and business analytics, with opportunities to contribute to broader software engineering initiatives.\nKey Responsibilities\nDesign, build, deploy, and maintain scalable ETL/ELT pipelines using AWS services.\n\nIngest, process, and transform data from multiple source systems into the organization’s data warehouse.\n\nWrite, optimize, and maintain complex SQL queries for data transformation, modeling, reporting, and analytics.\n\nDevelop reliable data models that support business intelligence dashboards, reporting, and business analysis.\n\nOrchestrate data workflows using Apache Airflow, AWS Step Functions, or similar technologies.\n\nMonitor pipeline performance and data freshness, investigate failures, and implement sustainable solutions.\n\nCollaborate with Business Intelligence teams to improve data accuracy, consistency, and reliability.\n\nEstablish effective feedback loops between Data Engineering and Business Intelligence teams to address data-quality issues.\n\nIdentify and resolve pipeline bottlenecks, data discrepancies, and recurring operational problems.\n\nImprove pipeline scalability, performance, observability, and cost efficiency.\n\nApply data validation and quality-control practices throughout pipeline development and maintenance.\n\nUse AI-assisted development tools, such as Claude Code, to support development and iteration.\n\nParticipate in code reviews and follow established software engineering and version-control standards.\n\nMaintain clear technical documentation for data pipelines, models, workflows, and system dependencies.\n\nSupport broader backend and software engineering initiatives as business and team needs evolve.\n\nContribute to additional data engineering and technology-related projects as required.\n\nRequirements\nBachelor’s degree in Computer Science, Software Engineering, Data Science, Information Technology, or a related discipline.\n\n2-3 years of professional experience in data engineering or a backend or software engineering role involving substantial data-related work.\n\nStrong SQL skills, including experience writing and optimizing complex queries.\n\nProficiency in Python for data pipeline development, automation, and data processing.\n\nHands-on experience with AWS data services such as Amazon S3, AWS Glue, Amazon Redshift, AWS Lambda, Amazon Athena, and Amazon EventBridge.\n\nPractical experience with Apache Airflow or AWS Step Functions for workflow orchestration.\n\nStrong understanding of data modeling fundamentals, including normalization and dimensional modeling.\n\nFamiliarity with Git and collaborative software development workflows.\n\nAbility to troubleshoot data-quality issues, pipeline failures, and performance bottlenecks.\n\nStrong analytical, problem-solving, and cross-functional communication skills.\n\nExperience with dbt for SQL-based data transformation is preferred.\n\nFamiliarity with Terraform or other infrastructure-as-code tools is preferred.\n\nExperience with CI/CD pipelines using GitHub Actions, AWS CodePipeline, or similar tools is preferred.\n\nExperience with data monitoring, observability, and pipeline cost optimization is preferred.\n\nFamiliarity with AI coding assistants such as Claude Code is preferred.\n\nUnderstanding of data governance, validation, and quality-control practices is preferred.\n\nInterest in expanding into backend or broader software engineering responsibilities is preferred.","description_format":"text","description_chars":3976,"description_truncated":false,"requirements":{"experience_years_min":2,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Online Reviews & Ratings"],"lifecycle":[{"event":"open","at":"2026-11-20T20:59:37Z"}],"visa":[],"liveness":{"score":8,"band":"cold","label":"Long shot","p_open":1,"p_active":0.298,"p_room":0.28,"age_days":109,"expected_fill_days":25,"reasons":["conf:0","win:tail","crowd:junior"],"computed_at":"2026-11-21T17:54:17Z"},"pay":null,"html_url":"https://alion.io/job/software-finder-data-engineer","json_url":"https://alion.io/job/software-finder-data-engineer.json","meta":{"generated_at":"2026-11-21T17:54:17Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":29847,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-22T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1796337},"rest":"https://alion.io/mcp/rest/get_company?id=1796337"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsoftware-finder-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsoftware-finder-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsoftware-finder-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/software-finder-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsoftware-finder-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4716073}},{"tool":"search_jobs","arguments":{"company":"softwarefinder.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4716073},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}