{"id":3235125,"url":"https://alion.io/job/payglocal-data-engineer","title":"Data Engineer","company":{"id":180408,"name":"PayGlocal","domain":"payglocal.in","url":"https://alion.io/company/payglocal","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"middle","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":14500,"max_usd":38000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":21},"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon Aurora","optional":false},{"name":"Amazon CloudWatch","optional":false},{"name":"Amazon EventBridge","optional":false},{"name":"Amazon S3","optional":false},{"name":"AWS","optional":false},{"name":"AWS Glue","optional":false},{"name":"AWS Lambda","optional":false},{"name":"Boto3","optional":false},{"name":"Dependency Injection","optional":false},{"name":"DynamoDB","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"IAM","optional":false},{"name":"Java","optional":false},{"name":"Lombok","optional":false},{"name":"Maven","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Presto","optional":false},{"name":"Python","optional":false},{"name":"Spring Boot","optional":false},{"name":"SQL","optional":false},{"name":"Trino","optional":false}],"status":"live","first_seen_at":"2026-10-25T10:35:30Z","employer_posted_date":null,"last_verified_at":"2026-10-25T10:35:30Z","board_verified":false,"closed_at":null,"days_open":5,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":5},"description":"Responsibilities: \nData Requirements and Reporting. Deliver data requirements raised by internal and external stakeholders, including regulatory, finance, banking, compliance, sales, business development, operations, core processing, and SRE teams. Automate recurring requirements to reduce manual effort.\nLambda Development. Build and maintain AWS Lambda functions in Python and Java for scheduled reports, event-driven processing, and ad-hoc data extractions. Integrate Lambdas with S3 DynamoDB, Aurora PostgreSQL, SQS, and EventBridge.\nAthena and SQL. Author and optimize Athena (Presto / Trino) queries against the datalake. Manage partition strategies and joins across merchant, onboarding, transaction, settlement, and reconciliation datasets.\nReporting Pipelines. Build and maintain daily, weekly, and monthly reporting pipelines that feed operations, finance, sales, and regulatory workflows.\nDashboards. Develop and maintain QuickSight dashboards for payment success rate analysis, liability monitoring, settlement tracking, and merchant performance, including custom SQL data sources and KPI tracking.\nMerchant Monitoring. Build and maintain merchant-monitoring pipelines and dashboards covering PSR trends, transaction volume and count anomalies, settlement timeliness, liability exposure, and dormancy. Investigate PSR drops at the merchant level and surface findings to Operations, Risk, and Account Management.\nData Modeling. Design DynamoDB schemas, Aurora table structures, and Glue Catalog DDLs for new data domains. Map nested JSON structures into Athena-compatible schemas.\nCross-team Collaboration. Work with Engineering, Risk, Banking, Operations, and Compliance to translate business requirements into data deliverables.\nOperational Support. Debug failing Lambdas, investigate data quality issues, and resolve constraint violations and pipeline errors. Maintain CloudWatch alerts and monitoring.\n\nRequirements: \nPython. Python 3 x dataclasses, type hints, comprehensions, context managers, JSON and CSV processing, error handling, and AWS Lambda handlers using boto3\nJava. Java 17 Spring Boot, Lombok, AWS Lambda Java runtimes, dependency injection, command-line runners, and OpenCSV.\nSQL and Athena. Joins, CTEs, window functions, UNIONs, partition filters, and date functions. Familiarity with Presto / Trino syntax (date_parse, from_iso8601_timestamp, date_format).\nAWS Services. Hands-on experience with Lambda, S3 DynamoDB, Aurora PostgreSQL, Athena, Glue, SQS, EventBridge, IAM, and CloudWatch.\nData Engineering Fundamentals. Partitioning, batch and streaming patterns, ETL design, schema evolution, and data quality controls.\nTooling. AWS CLI, Git, Maven, IntelliJ / PyCharm, and command-line workflows.\nTechnology Stack Layer: Technologies, Languages: Python 3 x, Java 17 (Spring Boot), SQL Compute AWS Lambda (Python and Java runtimes), EventBridge schedules, SQS triggers Storage AWS S3 DynamoDB, Aurora PostgreSQL, RDS Query and Analytics Athena (Presto / Trino), Glue Catalog, AWS Data Lake Visualization Amazon QuickSight Messaging SQS, SNS, DynamoDB Streams; Tooling AWS CLI, Git, Maven, IntelliJ IDEA, PyCharm, CloudWatch; Frameworks Spring Boot (for Lambda), boto3 psycopg2 OpenCSV, Lombok.\n\nInternal Preferred Skills: \nExperience in the payments domain (acquirers, issuers, FIRC, settlements, MDR, MCC, TID config, 3DS authentication).\nExperience integrating with notification systems (SQS-driven email pipelines, Thymeleaf templates).\nFamiliarity with QuickSight (dashboards, custom SQL, calculated fields, parameters).\nExperience with DynamoDB GSIs and query optimization.\nExposure to schema mappers, JSON-to-CSV flatteners, and ingestion frameworks.\nUnderstanding of GCM-encrypted DynamoDB items and DEK-based decryption patterns.\nSkills\nAWS, Athena, DynamoDB, Java, Lambda, Python, SQL","description_format":"text","description_chars":3828,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Payment Processing & Gateways"],"lifecycle":[{"event":"open","at":"2026-10-25T10:35:30Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.858,"p_room":1,"age_days":4,"expected_fill_days":30,"reasons":["seen:4","win:early"],"computed_at":"2026-10-30T05:48:23Z"},"pay":null,"html_url":"https://alion.io/job/payglocal-data-engineer","json_url":"https://alion.io/job/payglocal-data-engineer.json","meta":{"generated_at":"2026-10-30T11:42:21Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":16744,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-31T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":180408},"rest":"https://alion.io/mcp/rest/get_company?id=180408"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fpayglocal-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fpayglocal-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fpayglocal-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/payglocal-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fpayglocal-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3235125}},{"tool":"search_jobs","arguments":{"company":"payglocal.in","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3235125},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}