{"id":53030,"url":"https://alion.io/job/fastmarkets-data-engineer","title":"Data Engineer","company":{"id":8192,"name":"Fastmarkets","domain":"fastmarkets.com","url":"https://alion.io/company/fastmarkets","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"SmartRecruiters","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"middle","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Sofia, Bulgaria"],"countries":["BG"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":24000,"max_usd":65000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":865},"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Anthropic","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Azure DevOps","optional":false},{"name":"CI/CD","optional":false},{"name":"Claude","optional":false},{"name":"Copilot","optional":false},{"name":"Cortex","optional":false},{"name":"Dagster","optional":false},{"name":"Data Vault","optional":false},{"name":"dbt","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Fivetran","optional":false},{"name":"GCP","optional":false},{"name":"Git","optional":false},{"name":"GitHub","optional":false},{"name":"GitHub Actions","optional":false},{"name":"Kubernetes","optional":false},{"name":"MS SQL","optional":false},{"name":"Pandas","optional":false},{"name":"Prefect","optional":false},{"name":"Python","optional":false},{"name":"Snowflake","optional":false},{"name":"SQL","optional":false},{"name":"Apache Kafka","optional":true},{"name":"Prometheus","optional":true},{"name":"Prompt Engineering","optional":true},{"name":"Pulumi","optional":true},{"name":"Terraform","optional":true}],"status":"live","first_seen_at":"2026-08-12T10:41:24Z","employer_posted_date":"2026-08-12","last_verified_at":"2026-10-16T06:08:59Z","board_verified":true,"closed_at":null,"days_open":64,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":64},"description":"Fastmarkets is an industry-leading price-reporting agency (PRA) and information provider for global commodities, providing price data, news, analytics and events for the agriculture, forest products, metals and mining and new-generation energy markets.\nFastmarkets' data is critical for customers seeking to understand and predict dynamic, sometimes opaque markets, enabling trading and risk management. Fastmarkets is a global business with a history dating back to 1865 and is built on trust and deep market knowledge. It has more than 700 employees spread across global locations in the UK, US, China, India, Singapore, Brazil, Belgium, Bulgaria, Finland and beyond.\n The Role\nThe Fastmarkets Data Platform team sits within the Technology function and is responsible for developing and delivering the company’s data strategy through data engineering, insights, analytics, and business intelligence. The team has built the organisation’s entire modern data platform from scratch and continues to evolve it to support Fastmarkets’ growth and AI ambitions.\nReporting directly into the Head of Data Architecture, Engineering & AI, we are looking for the right candidate to model and build our data pipelines and transformations. This is a fantastic opportunity to join us and contribute to a high-performing workstream delivering transformational change across both BI and our monetizable data assets. You will work with modern technologies and frameworks - with input to help deliver and adapt processes that enable a true “DataOps” environment and development experience.\nThe Data Engineer will ensure that data is cleansed, tested, and delivered in accordance with Fastmarkets and industry best practice. In addition, the Data Engineer will enable monitoring via the observability platform and ensure that notifications and alerts are appropriately configured.\nWe actively leverage AI tools across the data engineering workflow, including Anthropic Claude for documentation, code generation, and code review, as well as Snowflake Cortex AI capabilities for in-platform intelligence. The successful candidate will be expected to embrace AI-assisted development as a core part of how we work.\nThe role requires a high standard of expertise in SQL and Python as well as specialist knowledge of modern approaches to delivering data projects using a code-first approach.\n\nPrincipal Accountabilities\nDesign, develop, and maintain scalable and efficient data pipelines from a wide variety of sources\n\nUse dbt (Data Build Tool) to transform data through the various layers (Cleansed, Conformed, Presentation etc)\n\nAbility to write custom connectors (Python) and leverage out-of-the-box data-loading tools\n\nOperationalise enterprise data model by curating appropriate data models to service reporting, analytics, and data science use cases\n\nEmbed real-time, automated data quality checks, validations, exception handling, and alerting across all data pipelines\n\nWork within Dagster as the primary orchestration and observability platform for all data pipelines\n\nManage CI/CD workflows using GitHub, GitHub Actions, and Kubernetes\n\nUse zero-copy cloning and containerised on-demand development environments\n\nImplement and review RBAC policies within Snowflake and related platforms\n\nEmbrace DataOps and a code-first approach to all data engineering work\n\nIdentify and promote best practices in data engineering; recommend improvements to existing processes and systems\n\nLeverage AI-assisted development tools (Anthropic Claude, GitHub Copilot) to accelerate delivery and improve code quality\n\nExcellent problem-solving skills and ability to embrace change\n\nEffective communication and collaboration skills\n\nNatural self-starter, with enthusiasm for learning and research\n\nKEY INTERFACES\nInternal:\nHead of Data Architecture, Engineering & AI\n\nData Engineering team\n\nTechnology & Infrastructure teams\n\nEditorial and Pricing teams\n\nBI & Analytics teams & stakeholders across the business\n\nProduct and Commercial teams\n\nExternal:\nConsultancy partners supporting platform delivery\n\nSnowflake technical account team\n\nThird-party vendor and tooling support\n\n We recruit talented, dynamic people with diverse backgrounds and experiences, all united by a belief in our mission to provide the world’s leading and most trusted price reporting, events, and intelligence service for the markets we serve. We’re proud to be an equal opportunities employer and are committed to creating a fully inclusive workplace, where everyone feels able to participate and contribute meaningfully.\nIf you are open-minded, curious, resilient, solutions-oriented and committed to promoting equality, then read on.\nKNOWLEDGE, EXPERIENCE AND SKILLS\nWe are looking for an individual who is highly motivated, driven, and have a passion to be part of a fast-paced, successful team. Being a strong team player is also important as well as someone who is happy to work flexibly.\nEssential\nAdvanced SQL Expertise - CTEs, stored procedures, query tuning - across more than one flavour of SQL (e.g. Snowflake, MSSQL). Snowflake experience is MANDATORY.\n\ndbt (Data Build Tool) and Jinja templating\n\nExtensive hands-on experience with Snowflake as a cloud data warehouse, including Snowpark for Python-based transformations\n\nExperience with ELT/ETL ingestion tools such as Fivetran, Airbyte, or similar connector-based platforms\n\nPython data pipelines and libraries including Pandas and GreatExpectations for data quality\n\nExperience with Python-based orchestration platforms such as Dagster, Apache Airflow, or Prefect\n\nAPI integration and JSON parsing/transformation\n\nGit version control (branching, pull requests, merge conflict resolution)\n\nCI/CD principles and experience (GitHub Actions, Azure DevOps)\n\nCloud Services experience (Azure, AWS, or GCP) - ability to identify and configure suitable cloud services and resources. Azure preferred but not mandatory.\n\nSolid understanding of data modelling approaches (3NF, Star Schema, Kimball/Inmon, OBT). Data Vault 2.0 knowledge is desirable.\n\nExcellent analytical and problem-solving skills with experience working with large and complex data sets\n\nStrong communication skills with attention to detail\n\nDesirable\nKubernetes and container orchestration\n\nInfrastructure as Code (Terraform, Pulumi, or similar)\n\nSnowflake Cortex AI and Snowflake native app development\n\nEvent streaming technologies (Azure Service Bus, Kafka, or similar)\n\nExposure to CRM systems such as Salesforce and marketing platforms such as Marketo\n\nExperience with AI-assisted development workflows and prompt engineering\n\nFormal Qualifications\nDegree in a related technology field OR 3+ years’ experience in a similar role with professional certifications\n\nSnowflake - nice-to-have - SnowPro Certification\n\nIf you're excited about the role but your experience, skills or qualifications don't perfectly align, we encourage you to apply anyway.\n Our Values\nFastmarkets people come from all different walks of life. It’s this mix of brilliant personalities, experiences and insights that gives us that warm, open, and friendly culture you can feel as soon as you meet us. But however wonderfully different we all are, there are six things we all have in common - and they form our Fastmarkets values.\nCreated by our own employees to reflect some of the personal traits that Fastmarkets people have, our values are key to what makes our culture unique. They reflect who each of us are and they're embedded in everything we do. Our values are:\nMETRICS DRIVEN. We use insights to improve our customers’ experience and our business performance\nACCOUNTABLE. We are accountable to ourselves and those we work with: we keep our promises and get things done\nGROWTH MINDSET. This value enables us to be nimble to the changing realities and operate with a sense of urgency\nINCLUSIVE. We are inclusive and respectful, celebrating each of us and giving everyone a deep sense of belonging with the desire to bring their best self to work every day.\nCUSTOMER CENTRIC. We are customer-centric in all that we do\nCOLLABORATIVE. We are collaborative, able to work across teams and capitalise on the diversity of intellect, perspectives, and experiences.\nWe are committed to ensuring all candidates feel welcomed and supported. Should your application advance and you require accommodations for the interview process, please inform us so we can make the necessary arrangements.\nReward and benefits at Fastmarkets\nWe believe in fair pay and benefits that support you both inside and outside of work. Through Fastmarkets Rewards, you'll have access to a range of core benefits and a flexible allowance, giving you the freedom to tailor your package to suit your lifestyle, wellbeing and financial priorities. We know that everyone's needs are different, so we've designed our benefits to support our diverse global team wherever they're based.\nSpecific benefits may vary by country and role.\nYou’ve read a little about us - now it’s over to you!\nIf you like what you’ve read so far and think you can see yourself as a Fastmarkets person, it’s time to fill in your application form. This form is an important part of the selection process: it’s used to determine whether or not you’ll be chosen to have an interview and acts as a basis for the questions we’ll ask you on the day.\nIt’s vital that you try to capture all the relevant information we have asked for on the form so we can get a good feel for who you are and why you’re great.","description_format":"text","description_chars":9488,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"Bulgaria","iso":"BG","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Market Research","Financial Data & Market Intelligence","Financial News & Media"],"lifecycle":[{"event":"open","at":"2026-08-12T10:41:24Z"}],"visa":[],"liveness":{"score":15,"band":"cold","label":"Long shot","p_open":1,"p_active":0.519,"p_room":0.28,"age_days":64,"expected_fill_days":21,"reasons":["conf:3","win:tail","crowd:"],"computed_at":"2026-10-16T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/fastmarkets-data-engineer","json_url":"https://alion.io/job/fastmarkets-data-engineer.json","meta":{"generated_at":"2026-10-16T10:15:26Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":8530,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-17T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":8192},"rest":"https://alion.io/mcp/rest/get_company?id=8192"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ffastmarkets-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ffastmarkets-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ffastmarkets-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/fastmarkets-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ffastmarkets-data-engineer"}]}