{"id":2444480,"url":"https://alion.io/job/beyondsoft-data-engineer","title":"Data Engineer","company":{"id":58994,"name":"Beyondsoft","domain":"beyondsoft.com","url":"https://alion.io/company/beyondsoft","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"iCIMS","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"posting_text","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":["India"],"countries":["IN"],"hiring_countries":["IN","SG"],"hiring_countries_total":2,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Embeddings","optional":false},{"name":"ETL/ELT","optional":false},{"name":"LLM","optional":false},{"name":"Prompt Engineering","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"SQL","optional":false},{"name":"Azure Data Factory","optional":true},{"name":"Azure DevOps","optional":true},{"name":"Azure SQL Database","optional":true},{"name":"Git","optional":true},{"name":"OpenAI","optional":true},{"name":"Rest API","optional":true}],"status":"live","first_seen_at":"2026-10-13T13:08:27Z","employer_posted_date":"2026-10-13","last_verified_at":"2026-10-14T21:14:25Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"Overview\nWHO WE ARE:\nBeyondsoft is a leading mid-sized business IT and consulting company that combines modern technologies and proven methodologies to tailor solutions that move your business forward.Our global head office is based in Singapore, and our team is made up of a diversely talented team of experts who thrive on innovation and pushing the bounds of technology to solve our customers’ most pressing challenges.When it comes time to deliver, we set our sights on that sweet spot where brilliance, emerging technologies, best practices, and accountability converge. We have a global presence spanning four continents (North America, South America, Europe, and Asia). Our global network of talent and customer-centric engagement model enables us to provide top-quality services on an unprecedented scale.\nWHAT WE’RE ABOUT:\nWe believe that collaboration, transparency, and accountability are the values that guide our business, our delivery, and our brand. Everyone has something to bring to the table, and we believe in working together with our peers and clients to leverage the best of one another in everything we do. When we proactively collaborate, business decisions become easier, innovation is greater, and outcomes are better.\nOur ability to achieve our mission and live out our values depends upon a diverse, equitable, and inclusive culture. So, we strive to foster a workplace where people have the respect, support, and voice they deserve, where innovative ideas flourish, and where people can unleash their brilliance. For more information regarding DEI at Beyondsoft, please go to https://www.beyondsoft.com/diversity/.\nADDITIONAL REQUIREMENT FOR REMOTE POSITIONS:\nFor remote positions, all candidates must complete a video screen with our corporate recruiting team.\nResponsibilities\nPOSITION SUMMARY:\nWe are seeking an experienced Data Engineer In India with strong expertise in Python, SQL, and Azure Databricks to design, build, and maintain scalable cloud-based data solutions.\nThe ideal candidate will have hands-on experience developing production-grade data pipelines, transforming and managing large datasets, and building reliable data solutions on Azure. In addition, the candidate should have a good understanding of Large Language Models (LLMs) and Generative AI, with experience or strong interest in integrating LLM capabilities into data and AI solutions.\nYou will work closely with engineers, analysts, and business stakeholders to build reliable data platforms and enable data-driven and AI-powered applications.\nWHAT YOU WILL BE DOING:\nDesign, develop, and maintain scalable data pipelines using Azure Databricks, Python, and SQL.\nDevelop ETL/ELT workflows for ingesting, transforming, validating, and publishing data from multiple data sources.\nBuild and maintain Azure Databricks notebooks, workflows, and jobs for production data processing.\nDevelop reusable Python components for data ingestion, transformation, automation, and integration.\nWrite and optimize complex SQL queries for data transformation, analytics, and reporting.\nWork with large-scale structured and semi-structured datasets.\nDesign and maintain reliable data models and data processing workflows.\nMonitor data pipelines and troubleshoot data quality, reliability, and performance issues.\nImplement appropriate logging, monitoring, error handling, and data quality controls.\nExplore and integrate LLM and Generative AI capabilities into data engineering solutions and applications.\nDevelop data preparation and processing workflows to support LLM-based applications.\nWork with LLM APIs and services to enable use cases such as information extraction, summarization, classification, and intelligent data processing.\nCollaborate with engineering and business teams to identify opportunities where LLM technologies can improve data processing and automation.\nParticipate in technical design, code reviews, testing, deployment, and production support.\nFollow engineering best practices for source control, CI/CD, security, documentation, and maintainability.\nQualifications\nMINIMUM QUALIFICATIONS:\nStrong hands-on experience with Azure Databricks.\nStrong programming skills in Python.\nStrong proficiency in SQL, including complex queries, data transformation, and query optimization.\nHands-on experience designing and developing production-grade ETL/ELT data pipelines.\nExperience working with large-scale structured and semi-structured datasets.\nSolid understanding of data modeling, data warehousing, and modern cloud-based data architectures.\nExperience troubleshooting and optimizing data pipelines and data processing workloads.\nGood understanding of Large Language Models (LLMs) and Generative AI concepts.\nFamiliarity with integrating LLM APIs or AI services into applications or data processing workflows.\nUnderstanding of common LLM concepts such as prompt engineering, embeddings, vector search, and Retrieval-Augmented Generation (RAG).\nStrong problem-solving and analytical skills.\nGood communication and collaboration skills.\nRequired Skills: Python, SQL, Azure Databricks, ETL/ELT, data pipeline development, data processing and transformation, LLM/generative AI fundamentals, LLM API integration, prompt engineering, RAG fundamentals.\nPREFERRED QUALIFICATIONS:\nExperience with Azure OpenAI Service or other enterprise LLM platforms.\nExperience developing RAG-based applications or solutions.\nFamiliarity with vector databases or vector search technologies.\nExperience preparing and managing enterprise data for LLM-based applications.\nExperience with Azure Data Factory for data integration and orchestration.\nExperience with Azure Data Lake Storage (ADLS).\nExperience with Azure SQL, Azure Synapse Analytics, or other cloud-based data platforms.\nExperience with REST APIs and integrating external services into data pipelines.\nExperience with CI/CD, Git, and Azure DevOps.\nKnowledge of data security, governance, access control, and data quality best practices.\nUnderstanding of responsible AI, data privacy, and security considerations when working with LLMs.\nRelevant Azure, Databricks, or AI certification is a plus.\nPreferred Skills: Azure OpenAI, embeddings/vector search, RAG application development, Azure Data Factory, Azure Data Lake Storage, Azure SQL/Azure Synapse Analytics, REST API integration, Git/Azure DevOps/CI/CD, data governance and security.\nBeyondsoft provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type with regards to race, color, religion, age, sex, national origin, disability status, genetics, veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, and the full employee lifecycle up through and including termination.","description_format":"text","description_chars":6939,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"},{"name":"Singapore","iso":"SG","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-10-13T13:08:27Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":14,"reasons":["conf:0","win:early"],"computed_at":"2026-10-14T06:34:16Z"},"pay":null,"html_url":"https://alion.io/job/beyondsoft-data-engineer","json_url":"https://alion.io/job/beyondsoft-data-engineer.json","meta":{"generated_at":"2026-10-14T22:58:00Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":7,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-15T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":58994},"rest":"https://alion.io/mcp/rest/get_company?id=58994"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fbeyondsoft-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fbeyondsoft-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fbeyondsoft-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/beyondsoft-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fbeyondsoft-data-engineer"}]}