{"id":3855617,"url":"https://alion.io/job/j-p-morgan-workplace-solutions-lead-software-engineer-big-datadata-engineer-python-and-aws","title":"Lead Software Engineer - Big Data(Data Engineer), Python, and AWS","company":{"id":1848842,"name":"J.P. Morgan Workplace Solutions","domain":"jpmorganworkplacesolutions.com","url":"https://alion.io/company/jpmorganworkplacesolutions","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Oracle","truth_index":{"grade":"A","score":99,"open_postings":295,"ghost_share":0.044,"stale_share":0.003,"repost_share":0.241,"time_to_fill_p50_days":10,"computed_at":"2026-11-07T05:47:08Z"}},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Plano, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Amazon EventBridge","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Iceberg","optional":false},{"name":"API Gateway","optional":false},{"name":"AWS","optional":false},{"name":"AWS Lambda","optional":false},{"name":"AWS Step Functions","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false},{"name":"Snowflake","optional":true}],"status":"live","first_seen_at":"2026-11-05T18:34:39Z","employer_posted_date":"2026-11-05","last_verified_at":"2026-11-08T01:35:48Z","board_verified":true,"closed_at":null,"days_open":2,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":2},"description":"We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.\nAs a Lead Software Engineer at JPMorganChase within the CIB, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology data products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for maintaining critical data pipelines and architectures across multiple technical areas within various business functions in support of the firm’s business objectives.\nJob responsibilities\nExecutes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or breakdown technical problems\nDelivers data collection, storage, access, and analytics data platform solutions in a secure, stable, and scalable way\nUses enterprise-authorized AI capabilities within the work environment to accelerate data products and model design analysis and documentation, validating outputs and handling data according to sensitivity and security requirements.\nEvaluates and reports on access control processes to determine effectiveness of data asset security with minimal supervision\nApplies reuse-first, AI-assisted practices within delivery and operational routines (e.g., backup/recovery validation and access control review support), ensuring traceability/auditability and alignment to resiliency and security expectations.\nDevelops secure and high-quality production code, and reviews and debugs code written by others\nIdentifies opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems\nRequired qualifications, capabilities, and skills\nFormal training or certification on data engineering concepts and 5+ years applied experience \nProficient at processing and analyzing large datasets using Big Data technologies, including Apache Spark, across data platforms comprising of Redshift, SQL DB, RDS and Databricks.\nDesign, development, and implementation of scalable data pipelines and data matching solutions on AWS, utilizing Python for data engineering tasks.\nStrong experience in setup and configuration of services such as S3, Step Functions, EMR, Glue, Lambda, RDS, EventBridge, Step-Functions and API Gateway for scripting, automation, and orchestration of data workflows.\nStrong hands-on experience with Databricks and distributed data processing technologies.\nUnderstanding of data architecture, data modeling, data integration, and data product principles.\nExperience designing and operating large-scale data platforms and data products in complex enterprise environments.\nDevelopment of semantic layer for data consumption using Iceberg tables and APIs. \nImplementation of continuous deployment and integration processes using Infrastructure as Code tools, including Terraform.\nTroubleshoot and resolve issues related to application code and data workflows.\nDemonstrated experience using enterprise-authorized AI capabilities within the work environment to support data engineering workflows with strong validation habits and awareness of data sensitivity.\nWorking experience with both relational and NoSQL databases\nAdvanced in one or more programming language(s)\nAdvanced understanding of agile methodologies such as CI/CD, Application Resiliency, and Security\nPreferred qualifications, capabilities, and skills\nExperience working with modern enterprise data platforms and cloud-native data architectures.\nExperience supporting real-time, analytical, or AI/ML-oriented data use cases.\nDatabricks, Snowflake, AWS cloud, or Data Engineering certifications","description_format":"text","description_chars":3754,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-11-06T06:04:49Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":1,"expected_fill_days":10,"reasons":["conf:1","win:early","comp:brand"],"computed_at":"2026-11-07T05:47:08Z"},"pay":null,"html_url":"https://alion.io/job/j-p-morgan-workplace-solutions-lead-software-engineer-big-datadata-engineer-python-and-aws","json_url":"https://alion.io/job/j-p-morgan-workplace-solutions-lead-software-engineer-big-datadata-engineer-python-and-aws.json","meta":{"generated_at":"2026-11-08T01:46:35Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":3862,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-09T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1848842},"rest":"https://alion.io/mcp/rest/get_company?id=1848842"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fj-p-morgan-workplace-solutions-lead-software-engineer-big-datadata-engineer-python-and-aws"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fj-p-morgan-workplace-solutions-lead-software-engineer-big-datadata-engineer-python-and-aws"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fj-p-morgan-workplace-solutions-lead-software-engineer-big-datadata-engineer-python-and-aws"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/j-p-morgan-workplace-solutions-lead-software-engineer-big-datadata-engineer-python-and-aws\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fj-p-morgan-workplace-solutions-lead-software-engineer-big-datadata-engineer-python-and-aws"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3855617}},{"tool":"search_jobs","arguments":{"company":"jpmorganworkplacesolutions.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3855617},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}