Data Engineer

Join our American Airlines family, and you'll travel the world, grow your expertise, and become the best version of you. As you embark on a new journey, you'll tackle challenges with flexibility and grace, learning new skills and advancing your career while having the time of your life. Feel free to enrich both your personal and work life and hop on board!

Responsibilities:

• As one diverse, high-performing team dedicated to technical excellence, you will focus relentlessly on delivering unrivalled digital products that drive a more reliable and profitable airline.
• The Data Domain refers to the area within Information Technology that focuses on managing and leveraging data as a strategic asset. This includes data management, storage, integration and governance. The Data domain leans into Machine Learning and AI, as well as Data Science and Business Intelligence.
• This list is intended to reflect the current job, but there may be additional essential functions (and certainly non-essential job functions) that are not referenced. Management will modify the job or require other tasks be performed whenever it is deemed appropriate to do so, observing, of course, any legal obligations including any collective bargaining obligations.
• Work closely with source data application teams and product owners to design, implement and support analytics solutions that provide insights to make better decisions.
• Implement data migration and data engineering solutions using Azure products and services: (Azure Data Lake Storage, Azure Data Factory, Azure Functions, Event Hub, Azure Stream Analytics, Azure Databricks, etc. ) and traditional data warehouse tools.
• Perform multiple aspects involved in the development lifecycle - design, cloud engineering (Infrastructure, network, security, and administration), ingestion, preparation, data modelling, testing, CICD pipelines, performance tuning, deployments, consumption, BI, alerting, prod support.
• Provide technical leadership and collaborate within a team environment as well as work independently.
• Be a part of a DevOps team that completely owns and supports their product.
• Implement batch and streaming data pipelines using cloud technologies.
• Lead development of coding standards, best practices and privacy and security guidelines.
• Mentor others on technical and domain skills to create multi-functional teams.

Requirements:

• Bachelor's degree in Computer Science, Computer Engineering, Technology, Information Systems (CIS/MIS), Engineering or related technical discipline, or equivalent experience/training.
• 3+ years of software solution development using Agile and DevOps, operating in a product model that includes designing, developing, and implementing large-scale applications or data engineering solutions.
• 3+ years of data analytics experience using SQL.
• 3+ years of cloud development and data lake experience (prefer Microsoft Azure) including Azure Event Hubs, Azure Data Factory, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Power BI.

Preferred Qualifications - Education and Prior Job Experience:

• 5+ years of software solution development using Agile, DevOps, product model that includes designing, developing, and implementing large-scale applications or data engineering solutions.
• 5+ years of data analytics experience using SQL.
• 3+ years of full-stack development experience, preferably in Azure.
• 3+ years of cloud development and data lake experience (preferably Microsoft Azure), including Azure Event Hubs, Azure Data Factory, Azure Functions, ADX, ASA, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Power BI.
• Airline Industry Experience.
• 3+ years of Teradata Vantage development and administration.

Skills, Licenses, and Certifications:

• Expertise with the Azure Technology stack for data management, data ingestion, capture, processing, curation and creating consumption layers.
• Expertise in providing practical direction within the Azure Native cloud services.
• Azure Development Track Certification (preferred).
• Spark Certification (preferred).

Combination of Development, Administration and Support experience in several of the following tools/platforms required:

• Scripting: Python, Spark, Unix, SQL.
• Data Platforms: Teradata, Cassandra, MongoDB, Oracle, SQL Server, ADLS, Snowflake.
• Azure Data Explorer. Administration skills a plus.
• Azure Cloud Technologies: Azure Data Factory, Azure Databricks, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Azure Functions.
• CI/CD: GitHub, Jenkins, Azure DevOps, Terraform.
• BI Analytics Tool Stack - Cognos, Tableau, Power BI, Alteryx, Denodo, and Grafana.
• Data Governance and Privacy: Alation, Monte Carlo, Informatica and BigID.
• Ability to effectively communicate both verbally and in writing with all levels within the organisation.
• Physical ability necessary to safely and successfully perform the essential functions of the position, with or without any legally required reasonable accommodations that do not pose an undue hardship.