{"id":1560060,"url":"https://alion.io/job/visa-senior-data-engineer-data-lake","title":"Senior Data Engineer, Data Lake","company":{"id":83,"name":"Visa","domain":"visa.com","url":"https://alion.io/company/visa","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":84,"open_postings":127,"ghost_share":0,"stale_share":0.606,"repost_share":0.024,"time_to_fill_p50_days":26,"computed_at":"2026-10-06T05:45:30Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"posting_text","remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":["Brazil"],"countries":["BR"],"hiring_countries":["BR"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":58000,"max_usd":133000,"period":"year","method":"role_seniority_country_cell","sample_n":8},"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Amazon CloudWatch","optional":false},{"name":"Amazon S3","optional":false},{"name":"AWS","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"GitHub","optional":false},{"name":"Great Expectations","optional":false},{"name":"IAM","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Delta Lake","optional":true},{"name":"Superset","optional":true},{"name":"Terraform","optional":true}],"status":"live","first_seen_at":"2026-09-30T00:00:00Z","employer_posted_date":"2026-09-30","last_verified_at":"2026-10-07T01:30:06Z","board_verified":true,"closed_at":null,"days_open":7,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":7},"description":"About Us\nVisa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid.\nAt Visa, you'll have the opportunity to create impact at scale - tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world.\nJoin Visa and do work that matters - to you, to your community, and to the world. Progress starts with you.\nJob Description\nSummary\nWe're looking for a Data Engineer at the Analyst level to join our Data Lake team. You'll build and maintain data ingestion and transformation pipelines using Spark, Databricks, and Airflow, contributing to the reliability and quality of the corporate data lake. This is an intermediate role where you'll work under moderate supervision on defined tasks while building deeper expertise in lakehouse architecture.\nAt Pismo, the Data Lake team is responsible for centralizing and organizing data into a single, trusted platform that supports decision-making across the company and for external clients. We work on challenges such as scaling global data infrastructure, delivering high-quality reporting, and enabling secure, self-service access to data-helping teams move faster while avoiding information silos.\nWhat You'll Do :\nDevelop, test, and maintain data pipelines (ingestion, transformation, quality checks) using PySpark/SparkSQLon Databricks.\nBuild and modify Airflow DAGs(MWAA) for pipeline orchestration.\nWrite and optimize SQLqueries for data transformation and validation.\nSupport data quality by implementing and monitoring quality checks (Great Expectations or equivalent).\nParticipate in code reviews - both giving and receiving feedback.\nInvestigate pipeline failures and data quality issues with guidance from senior engineers.\nWrite and maintain documentation for datasets and pipelines you build.\nParticipate in sprint planning, estimation, and retrospectives.\nFollow CI/CD, testing, and governance standards defined by the team.\nThis is a remote position. A remote position does not require job duties beperformed within proximity of a Visa office location. Remote positions may be required to be present at a Visa office with scheduled notice. #LI-Remote\nQualifications\nFor this role, you must be based in Brazil\nLanguage Skills\nProficiency in English at B2 level or above (Upper-Intermediate) \nBasic Qualifications\n3+ years of relevant work experience with a Bachelor's or Associate’s Degree OR 5+ years of relevant work experience.\nPython for automation and data processing\nData pipeline concepts (batch, ETL/ELT patterns)\nTechnical Skills\nApache Spark basics (PySpark or SparkSQL) \nDatabricks (jobs, workflows, cluster management, tuning)\nSQL (intermediate-advanced: joins, window functions, CTEs)\nAmazon S3 data lake design (partitioning, layout, lifecycle)\nBasic cloud concepts (AWS: S3, IAM, CloudWatch) \nData modeling (dimensional / Kimball, medallion layers)\nGit/GitHub workflow and code review \nPreferred Qualifications :\nDelta Lake (ACID tables, OPTIMIZE, VACUUM, schema evolution, MERGE)\nApache Airflow / MWAA (DAG design, retries, backfills, SLAs)\nCDC patterns (DMS, incremental processing, MERGE upserts)\nData quality concepts (validation, testing) \nTerraform basics \nBI integration (Superset, dashboarding)\nVisa is an EEO Employer\nQualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.","description_format":"text","description_chars":3826,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"associate","optional":false},"security_clearance":false,"languages":[{"language":"English","level":"Upper-Intermediate (B2)","optional":false}]},"benefits":[],"hiring_locations":[{"name":"Brazil","iso":"BR","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Cards & Card Issuing","Payment Processing & Gateways"],"lifecycle":[{"event":"open","at":"2026-10-01T03:36:18Z"}],"visa":[],"liveness":{"score":63,"band":"ok","label":"Likely open","p_open":1,"p_active":0.632,"p_room":1,"age_days":6,"expected_fill_days":26,"reasons":["conf:0","stale_co","velocity","win:early","comp:brand"],"computed_at":"2026-10-06T05:45:30Z"},"pay":null,"html_url":"https://alion.io/job/visa-senior-data-engineer-data-lake","json_url":"https://alion.io/job/visa-senior-data-engineer-data-lake.json","meta":{"generated_at":"2026-10-07T02:23:46Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler","counted_by":"address","units_charged":1,"used_today":3992,"day_limit":5000,"remaining_today":1008,"minute_limit":60,"resets_at":"2026-10-08T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":83},"rest":"https://alion.io/mcp/rest/get_company?id=83"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fvisa-senior-data-engineer-data-lake"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fvisa-senior-data-engineer-data-lake"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fvisa-senior-data-engineer-data-lake"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/visa-senior-data-engineer-data-lake\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fvisa-senior-data-engineer-data-lake"}]}