{"id":4482248,"url":"https://alion.io/job/transflo-senior-data-engineer-2","title":"Senior Data Engineer","company":{"id":2909509,"name":"Transflo","domain":"transflo.com","url":"https://alion.io/company/transflo-com","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Paycor","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"remote","remote_scope":"unspecified","remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":[],"countries":[],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Amazon Aurora","optional":false},{"name":"Amazon EventBridge","optional":false},{"name":"Amazon Kinesis","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"AWS Glue","optional":false},{"name":"AWS Step Functions","optional":false},{"name":"Db2","optional":false},{"name":"dbt","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"DynamoDB","optional":false},{"name":"ETL/ELT","optional":false},{"name":"MySQL","optional":false},{"name":"PostgreSQL","optional":false},{"name":"Power BI","optional":false},{"name":"Python","optional":false},{"name":"SQL","optional":false},{"name":"Tableau","optional":false},{"name":"Terraform","optional":false}],"status":"live","first_seen_at":"2026-11-17T19:30:05Z","employer_posted_date":"2026-11-17","last_verified_at":"2026-11-17T19:30:05Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Transflo is a leading provider of mobile, telematics, and business process automation software for the transportation and logistics industry. Our solutions help freight carriers, brokers, and shippers automate and streamline their operations, reduce costs, and improve efficiency. We are on a mission to drive innovation in the industry by providing cutting-edge SaaS and AI solutions that enable seamless communication and collaboration across the supply chain.\nDESCRIPTION:\nTransflo is seeking a Senior Data Engineer to build our enterprise data platform - from raw ingestion through curated, analytics-ready data products. You will be a key engineer designing our data warehouse, data pipeline infrastructure, and the bronze-silver-gold medallion architecture that serves internal analytics teams, operational reporting, and our growing Transflo Intelligence Suite.\nThis role demands both deep technical expertise and a strategic mindset. You will work across a wide range of internal and external data sources including APIs, relational databases, NoSQL stores, file-based feeds, and streaming data. The work will include normalizing and modeling data into reliable, governed, and high-performance analytical assets. You will build and scale systems designed for near real-time data environments supporting high-traffic, mission-critical workloads in the transportation and logistics industry.\nCORE AREAS OF RESPONSIBILITY:\nArchitect, build, and evolve a scalable enterprise data warehouse on Amazon Redshift, applying industry-standard concepts including star schemas, snowflake schemas, and normalization. \nDesign and implement bronze, silver, and gold data layer architecture (medallion architecture): raw ingestion, cleansed and standardized intermediate layers, and curated analytics products. \nDevelop dimensional data models, fact and dimension tables, slowly changing dimensions (SCDs), and aggregate structures that support BI tooling, ad-hoc analytics, and other downstream systems. \nBuild, own, and maintain robust batch and streaming data pipelines that ingest data from disparate source systems including APIs, flat files, MySQL, Amazon Aurora, Amazon DynamoDB, etc. \nImplement real-time and near real-time data streaming architectures using AWS-native services such as Kinesis Data Streams, Kinesis Firehose, MSK (Managed Kafka), and EventBridge. \nDesign pipeline frameworks for data extraction, transformation, and loading (ETL/ELT) using tools such as AWS Glue, dbt, Apache Airflow, or equivalent orchestration platforms\nEnsure pipeline reliability, idempotency, fault tolerance, and automated recovery; build alerting and observability into every data workflow from day one\nOwn data quality: design and implement automated profiling, cleansing, deduplication, standardization, and validation frameworks that enforce data integrity\nBuild and continuously evolve tooling and processes to support data governance including data cataloging, lineage tracking, metadata management, access controls, and data classification\nDefine and enforce data contracts between source systems and the warehouse, establishing clear SLAs for freshness, completeness, and accuracy\nPartner with data consumers (e.g., Data scientists, Data analytics engineers, BI developers, and product managers) to understand consumption patterns and ensure data products meet quality and performance expectations\nContribute to the data platform infrastructure using infrastructure-as-code practices (Terraform), ensuring all data infrastructure is version-controlled, reproducible, and auditable\nDesign for scale: apply partitioning strategies, workload management (WLM) tuning, concurrency scaling, and caching patterns to sustain performance under high-traffic workloads\nChampion security and compliance best practices across the data platform: column-level security, row-level access controls, encryption, and audit logging\nCollaborate with software engineers, mobile platform teams, and DevOps to ensure upstream application data is well-structured, well-documented, and reliably delivered to the data platform\nLeverage AI-assisted development practices and tooling to accelerate pipeline development, automate data quality checks, and improve engineering velocity\nREQUIRED EXPERIENCE:\n5+ years of professional data engineering experience with a track record of building and operating production-grade data warehouses and pipeline infrastructure\nExpert-level experience with Amazon Redshift including cluster sizing, WLM configuration, distribution and sort key optimization, vacuuming, and query plan analysis\nDeep proficiency in SQL for complex analytical queries, window functions, CTEs, stored procedures, and performance tuning across Redshift and ANSI-compatible engines\nHands-on experience ingesting data from source systems: APIs, IBM DB2, MySQL, Amazon Aurora, Amazon DynamoDB, PostgreSQL, and file-based sources (CSV, JSON, Parquet, Avro, etc.)\nProven experience designing and implementing medallion or equivalent layered data architectures\nStrong working knowledge of star schema and snowflake schema design, dimensional modeling theory, slowly changing dimensions, and fact table granularity decisions\nProficiency with ETL/ELT tools such as AWS Glue, dbt, Apache Airflow, or AWS Step Functions\nDemonstrated experience implementing data governance practices: data catalogs (AWS Glue Data Catalog or equivalent), lineage, metadata tagging, and access control frameworks\nInfrastructure-as-code experience (ideally Terraform) for provisioning and managing infrastructure\nStrong Python skills for pipeline development, data transformation logic, and automation scripting\nDeep understanding of data reliability engineering: idempotency, exactly-once processing, late-arriving data handling, schema evolution, and SLA-driven pipeline design\nADDITIONAL SKILLS/EXPERIENCE:\nExperience building real-time data pipelines using streaming technologies such as Apache Kafka\nExperience in the transportation, logistics, trucking, or fleet management industry\nKnowledge of columnar storage formats (Parquet, ORC) and lakehouse patterns using Amazon S3 as a data lake layer in conjunction with Redshift Spectrum, Amazon Athena, and/or AWS Glue\nFamiliarity with BI and analytics consumption tools such as Tableau, Power BI, or Amazon QuickSight. \nExperience working in fully remote, distributed engineering teams","description_format":"text","description_chars":6393,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Transportation & Logistics","Supply Chain","Supply Chain & Logistics Software"],"lifecycle":[{"event":"open","at":"2026-11-17T19:30:05Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":30,"reasons":["conf:1","win:early"],"computed_at":"2026-11-17T20:57:32Z"},"pay":null,"html_url":"https://alion.io/job/transflo-senior-data-engineer-2","json_url":"https://alion.io/job/transflo-senior-data-engineer-2.json","meta":{"generated_at":"2026-11-17T20:57:32Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":3403,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2909509},"rest":"https://alion.io/mcp/rest/get_company?id=2909509"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ftransflo-senior-data-engineer-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ftransflo-senior-data-engineer-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ftransflo-senior-data-engineer-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/transflo-senior-data-engineer-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ftransflo-senior-data-engineer-2"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4482248}},{"tool":"search_jobs","arguments":{"company":"transflo.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4482248},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}