Data Reliability Engineer

Nova Web Technologies LLC is seeking a Data Reliability Engineer to ensure the performance, availability, reliability, security, and scalability of PostgreSQL and cloud-based data environments. The role focuses on supporting data pipelines, databases, streaming platforms, and workflow orchestration, while resolving incidents and improving operational efficiency.

Responsibilities

• Design, develop, maintain, and troubleshoot ETL/ELT data pipelines supporting large-scale data lakes and data warehouses
• Monitor PostgreSQL RDS instances for performance, availability, resource utilization, and overall system health
• Monitor CPU, memory, storage, database connections, and other PostgreSQL RDS metrics using tools such as AWS CloudWatch and Prometheus
• Identify PostgreSQL performance bottlenecks and perform basic database tuning, including query execution plan analysis, indexing, and parameter optimization
• Analyze SQL query performance and collaborate with development teams to optimize queries, database schemas, and data access patterns
• Monitor and troubleshoot Debezium and Kafka Connect connectors to ensure reliable data capture and delivery
• Monitor ETL workflows and data pipelines for failures, processing delays, data quality issues, and performance bottlenecks
• Monitor Apache Airflow DAGs, troubleshoot failed tasks, and rerun workflows as required
• Support data-related incidents, perform troubleshooting, and participate in root cause analysis (RCA)
• Develop automation scripts using Python, Bash, or similar scripting languages to improve operational efficiency
• Develop and maintain Infrastructure as Code (IaC) using tools such as Terraform and Crossplane
• Support database deployments, configuration changes, upgrades, and routine maintenance
• Implement and maintain database backup, recovery, and disaster recovery strategies
• Support database security through access controls, encryption, configuration reviews, and compliance practices
• Regularly audit database security configurations and identify potential risks or areas for improvement
• Assist with the design and optimization of database schemas for cloud environments
• Participate in on-call rotations and respond to database and data platform incidents
• Contribute to continuous improvement initiatives focused on data reliability, scalability, availability, and operational efficiency

Skills

• 13+ years of experience in data engineering, database engineering, data reliability, or related technology roles
• Extensive hands-on experience with PostgreSQL, preferably PostgreSQL running on AWS RDS
• Strong experience developing and supporting ETL/ELT data pipelines
• Strong SQL skills, including query development, troubleshooting, optimization, and data manipulation
• Strong experience with AWS cloud services, particularly database and data platform technologies
• Experience monitoring and troubleshooting production database environments
• Experience with database performance tuning, query execution plans, indexing, and schema optimization
• Experience with data pipeline monitoring, incident resolution, and root-cause analysis
• Experience with cloud database security, access controls, encryption, backup, and recovery
• Strong troubleshooting and problem-solving skills in production environments
• AWS: RDS, CloudWatch, S3, Redshift
• Databases: PostgreSQL, database performance tuning, schema design
• Data Engineering: ETL/ELT, data pipelines, data lakes, data warehouses
• Streaming: Debezium, Kafka, Kafka Connect
• Orchestration: Apache Airflow
• Data Processing: Apache Spark
• Automation: Python, Bash
• Infrastructure as Code: Terraform, Crossplane
• Monitoring: AWS CloudWatch, Prometheus
• Security: Database access controls, encryption, compliance, backup/recovery
• Familiarity with Amazon Redshift and Amazon S3
• Exposure to Apache Spark for data processing
• Working knowledge of Apache Airflow for workflow orchestration
• Experience supporting production data platforms and participating in on-call rotations
• Knowledge of database security and compliance requirements such as GDPR and HIPAA
• AWS Certified Database – Specialty certification

Company Overview

Company H1B Sponsorship