{"id":2383782,"url":"https://alion.io/job/seekadegree-backend-ai-data-pipeline-engineer","title":"Backend AI & Data Pipeline Engineer","company":{"id":4418531,"name":"Seekadegree","domain":"seekadegree.com","url":"https://alion.io/company/seekadegree","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"SmartRecruiters","truth_index":{"grade":"B","score":75,"open_postings":6,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-14T06:34:16Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":"junior","employment_type":"internship","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"posting_text","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":["Islamabad, Pakistan"],"countries":["PK"],"hiring_countries":["AU","MY","PK"],"hiring_countries_total":3,"salary":null,"salary_estimate":null,"experience_years_min":1,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon ECS","optional":false},{"name":"Amazon EventBridge","optional":false},{"name":"AWS","optional":false},{"name":"AWS Bedrock","optional":false},{"name":"AWS Fargate","optional":false},{"name":"AWS Lambda","optional":false},{"name":"AWS Step Functions","optional":false},{"name":"Embeddings","optional":false},{"name":"Knowledge Graph","optional":false},{"name":"LLM","optional":false},{"name":"Pandas","optional":false},{"name":"Python","optional":false}],"status":"live","first_seen_at":"2026-05-11T08:44:32Z","employer_posted_date":"2026-05-11","last_verified_at":"2026-10-13T11:27:19Z","board_verified":true,"closed_at":null,"days_open":156,"trust":{"level":"stale","repost_count":0,"flags":["stale"],"days_open":155},"description":"We believe strong early career roles should do more than give someone a job title. They should help people grow into the kind of professionals they want to become. At SEEKA Technologies, we give junior team members meaningful work that builds real capability, sharpens problem-solving, and develops practical experience in fast-moving business and technology environments. Our goal is to help emerging talent strengthen their skills, expand their potential, and prepare for a future shaped by constant innovation across business and IT.\nSEEKA Technologies (Not Seeka Limited) is a project under its parent organisation, called Fresh Futures Australia, which is an education consultant based in both Australia and Malaysia. We are developing and creating a platform that utilises A.I. to help match students and job seekers to the right opportunities relevant to them from Kindergarten up to the University, along with vocational training centres and language schools, and of course to businesses and companies who need the right candidates. Our mission is to make it easier for anyone to find, filter and apply to educational institutions and companies in a more seamless manner.\nWe are currently looking to hire a junior Backend AI & Data Pipeline Engineer who wants to build real-world experience in backend systems, data processing, scraping, retrieval, and cloud-based infrastructure. This role is ideal for someone who already has hands-on technical experience and wants to grow further by working on meaningful engineering challenges that support Yuzee’s intelligent matching platform. You will contribute to the systems that process data, power search and matching, and improve the efficiency, reliability, and scalability of our platform.\nBelow are the important details you will need to take note of:\nEnglish is the primary language used in the role\nThis is a full-time remote/work-from-home position\nWe welcome both local and international candidates\nCandidates should have a degree or proven practical experience relevant to the role\n About the role\nWe are looking for a Backend AI & Data Pipeline Engineer to own the end-to-end data processing infrastructure that powers Yuzee's intelligent course and job matching platform. You will design and maintain scalable, event-driven pipelines that process tens of thousands of daily records, generate semantic embeddings, and feed a growing knowledge graph used for personalised career pathway recommendations.\nWhat you'll do\nDesign and maintain three distinct processing pipelines - scheduled job ingestion, event-driven course processing, and a periodic knowledge graph builder - each with independent trigger logic and cost controls\nGenerate and manage semantic embeddings via Amazon Bedrock (Titan v2), index them in MongoDB Atlas Vector Search, and calibrate similarity thresholds to ensure match accuracy\nBuild and maintain a knowledge graph linking jobs, courses, skills, and industries using FP-Growth association rules and archetype-to-SOC code mapping\nBuild and improve a two-stage discovery and matching API on AWS Lambda - vector retrieval first, then deep eligibility scoring with LLM re-ranking\nRight-size Fargate Spot instances and design resumable processing loops that tolerate interruption, keeping infrastructure costs under control as data volume scales\nMaintain and improve daily job scrapers across multiple sources and build institution data scrapers with robust HTML cleaning pipelines\nWhat we're looking for\n1+ years of backend engineering experience focused on data pipelines, ML infrastructure, or search systems\nHands-on experience with AWS serverless and container services - Lambda, ECS Fargate, EventBridge, and Step Functions\nStrong Python skills - Pandas, async processing, bulk database operations, and text cleaning\nFamiliarity with vector databases and semantic similarity search; MongoDB Atlas Vector Search experience is a strong plus\nCost-conscious infrastructure mindset - you think in per-record compute costs, free tiers, Spot resilience, and right-sizing\nAbility to document and communicate complex architecture clearly to both technical and non-technical stakeholders\nNice to have\nExperience with knowledge graphs or association rule mining (FP-Growth, Apriori)\nExperience using LLMs for re-ranking or eligibility assessment on top of vector retrieval results\nBackground in edtech, jobtech, or recommendation/matching systems\n Degree or existing proven experience\n Benefits\nFully remote / work-from-home position\n\nSome flexibility in working hours, depending on team requirements and deliverables\n\nHands-on experience working on meaningful backend, data pipeline, and AI-related systems\n\nOpportunity to contribute to a growing platform with real product and engineering challenges\n\nProfessional growth in a practical, fast-paced environment\n\nStrong potential for long-term progression based on performance, regardless of location","description_format":"text","description_chars":4929,"description_truncated":false,"requirements":{"experience_years_min":1,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"All levels","optional":false}]},"benefits":[],"hiring_locations":[{"name":"Australia","iso":"AU","kind":"country"},{"name":"Malaysia","iso":"MY","kind":"country"},{"name":"Pakistan","iso":"PK","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-12T19:53:17Z"}],"visa":[],"liveness":{"score":5,"band":"cold","label":"Long shot","p_open":1,"p_active":0.179,"p_room":0.28,"age_days":155,"expected_fill_days":23,"reasons":["conf:19","win:tail","crowd:junior"],"computed_at":"2026-10-14T06:34:16Z"},"pay":null,"html_url":"https://alion.io/job/seekadegree-backend-ai-data-pipeline-engineer","json_url":"https://alion.io/job/seekadegree-backend-ai-data-pipeline-engineer.json","meta":{"generated_at":"2026-10-15T04:47:41Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":7054,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-16T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4418531},"rest":"https://alion.io/mcp/rest/get_company?id=4418531"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fseekadegree-backend-ai-data-pipeline-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fseekadegree-backend-ai-data-pipeline-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fseekadegree-backend-ai-data-pipeline-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/seekadegree-backend-ai-data-pipeline-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fseekadegree-backend-ai-data-pipeline-engineer"}]}