{"id":800821,"url":"https://alion.io/job/particle41-data-engineer","title":"Data Engineer","company":{"id":686023,"name":"Particle41","domain":"particle41.com","url":"https://alion.io/company/particle41-2","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"D","score":45,"open_postings":24,"ghost_share":0.917,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-30T05:48:23Z"}},"role":"Data Science","role_family":"Data Science","seniority":"middle","employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["India"],"countries":["IN"],"hiring_countries":["IN"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":14500,"max_usd":36000,"period":"year","method":"role_seniority_country_cell","sample_n":26},"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Databricks","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Flask","optional":false},{"name":"GCP","optional":false},{"name":"Machine Learning","optional":false},{"name":"MySQL","optional":false},{"name":"OpenCV","optional":false},{"name":"PostgreSQL","optional":false},{"name":"pySpark","optional":false},{"name":"Pytest","optional":false},{"name":"Python","optional":false},{"name":"Redis","optional":false},{"name":"Scikit-learn","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Git","optional":true},{"name":"Linux","optional":true}],"status":"live","first_seen_at":"2025-12-03T11:58:04Z","employer_posted_date":"2026-09-01","last_verified_at":"2026-10-30T17:42:59Z","board_verified":true,"closed_at":null,"days_open":331,"trust":{"level":"ghost","repost_count":0,"flags":["stale","company_stale"],"days_open":329},"description":"Data Engineer\nParticle41 is seeking a talented and versatile Data Engineer to join our innovative team. As a Data Engineer, you will play a key role in designing, building, and maintaining robust data pipelines and infrastructure to support our clients' data needs. You will work on end-to-end data solutions, collaborating with cross-functional teams to ensure high-quality, scalable, and efficient data delivery. This is an exciting opportunity to contribute to impactful projects, solve complex data challenges, and grow your skills in a supportive and dynamic environment.\nIn This Role, You Will:\n\nSoftware Development\nDesign, develop, and maintain scalable ETL (Extract, Transform, Load) pipelines to process large volumes of data from diverse sources.\nBuild and optimize data storage solutions, such as data lakes and data warehouses, to ensure efficient data retrieval and processing.\nIntegrate structured and unstructured data from various internal and external systems to create a unified view for analysis.\nEnsure data accuracy, consistency, and completeness through rigorous validation, cleansing, and transformation processes.\nMaintain comprehensive documentation for data processes, tools, and systems while promoting best practices for efficient workflows.\nRequirements Gathering and Analysis\nCollaborate with product managers, and other stakeholders to gather requirements and translate them into technical solutions.\nParticipate in requirement analysis sessions to understand business needs and user requirements.\nProvide technical insights and recommendations during the requirements-gathering process.\nAgile Development\nParticipate in Agile development processes, including sprint planning, daily stand-ups, and sprint reviews.\nWork closely with Agile teams to deliver software solutions on time and within scope.\nAdapt to changing priorities and requirements in a fast-paced Agile environment.\nTesting and Debugging\nConduct thorough testing and debugging to ensure the reliability, security, and performance of applications.\nWrite unit tests and validate the functionality of developed features and individual elements.\nWriting integration tests to ensure different elements within a given application function as intended and meet desired requirements.\nIdentify and resolve software defects, code smells, and performance bottlenecks.\nContinuous Learning and Innovation\nStay updated with the latest technologies and trends in full-stack development.\nPropose innovative solutions to improve the performance, security, scalability, and maintainability of applications.\nContinuously seek opportunities to optimize and refactor existing codebase for better efficiency.\nStay up to date with cloud platforms such as AWS, Azure, or Google Cloud Platform.\nCollaboration\nCollaborate effectively with cross-functional teams, including testers, and product managers.\nFoster a collaborative and inclusive work environment where ideas are shared and valued.\nSkills and Experience We Value:\nBachelor's degree in computer science, Engineering, or related field.\nProven experience as a Data Engineer, with a minimum of 3 years of experience.\nProficiency in Python programming language.\nExperience with database technologies such as SQL (e.g., MySQL, PostgreSQL) and NoSQL (e.g., MongoDB) databases.\nStrong understanding of Programming Libraries/Frameworks and technologies such as Flask, API frameworks, datawarehousing/lakehouse, principles, database and ORM, data analysis databricks, panda's, Spark, Pyspark, Machine learning, OpenCV, scikit-learn.\nUtilities & Tools: logging, requests, subprocess, regex, pytest\nELK stack, Redis, distributed task queues\nStrong understanding of data warehousing/lakehousing principles and concurrent/parallel processing concepts.\nFamiliarity with at least one cloud data engineering stack (Azure, AWS, or GCP) and the ability to quickly learn and adapt to new ETL/ELT tools across various cloud providers.\nFamiliarity with version control systems like Git and collaborative development workflows.\nCompetence in working on Linux OS and creating shell scripts.\nSolid understanding of software engineering principles, design patterns, and best practices.\nExcellent problem-solving and analytical skills, with a keen attention to detail.\nEffective communication skills, both written and verbal, and the ability to collaborate in a team environment.\nAdaptability and willingness to learn new technologies and tools as needed.\nAbout Particle41\n Our core values of Empowering, Leadership, Innovation, Teamwork, and Excellence drive everything we do to achieve the ultimate outcomes for our clients. Empowering Leadership for Innovation in Teamwork with Excellence ( ELITE )\nE - Empowering: Enabling individuals to reach their full potential\nL - Leadership: Taking initiative and guiding each other toward success\nI - Innovation: Embracing creativity and new ideas to stay ahead\nT - Teamwork: Collaborating with empathy to achieve common goals\n E - Excellence: Striving for the highest quality in everything we do\nWe seek team members who embody these values and are committed to contributing to our mission. Particle41 welcomes individuals from all backgrounds who are committed to our mission and values. We provide equal employment opportunities to all employees and applicants, ensuring that hiring and employment decisions are based on merit and qualifications without discrimination based on race, color, religion, caste, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, local, or international laws. This policy applies to all aspects of employment and hiring. \nWe appreciate your interest and encourage applicants from these regions to apply. If you need any assistance during the application or interview process, please feel free to reach out to us at .","description_format":"text","description_chars":5958,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Continuous learning"],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Custom Software Development","AI Consulting & Integration"],"lifecycle":[{"event":"open","at":"2026-09-12T07:41:27Z"}],"visa":[],"liveness":{"score":4,"band":"cold","label":"Long shot","p_open":1,"p_active":0.132,"p_room":0.28,"age_days":330,"expected_fill_days":35,"reasons":["conf:1","stale_co","ghost","win:tail","crowd:"],"computed_at":"2026-10-30T05:48:23Z"},"pay":null,"html_url":"https://alion.io/job/particle41-data-engineer","json_url":"https://alion.io/job/particle41-data-engineer.json","meta":{"generated_at":"2026-10-30T19:34:35Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":9056,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-31T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":686023},"rest":"https://alion.io/mcp/rest/get_company?id=686023"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fparticle41-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fparticle41-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fparticle41-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/particle41-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fparticle41-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":800821}},{"tool":"search_jobs","arguments":{"company":"particle41.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":800821},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}