Big Data Architect

Requirements :

- Minimum 10+ years of experience in Architecting and Solutioning in Snowflake, AWS, Big Data, and DW.

- Understanding of GDPR, AWS, and Snowflake Cortex for Generative AI.

- Implementation experience with frameworks to reduce estimation and cost in repeating work (e.g., Ingestion or Extraction of data).

- Proficiency in newly introduced Snowflake features and ability to propose new approaches based on customer standards.

- Understanding of secure coding standards, secure data sharing, and Data Clean Rooms.

- Experience with Snowflake, Spark (PySpark), and Big Data projects.

- Experience in Cloud Implementations (AWS ecosystem: S3, EC2).

- Knowledge of Hadoop ecosystem tools (Hive, HBase, Pig).

- Knowledge of Airflow, NiFi, Kafka, Panda, Lambda, and Snowflake.

- Knowledge of BI reporting tools and frameworks.

- Experience in data migration from legacy systems.

- Hands-on experience with Linux, Database, Data center setup, SQL, Java, and parallel processing.

- Proficient in technical documentation (UML, HLD, LLD).

Responsibilities :

- Responsible for high-level requirement gathering, consulting, design, development, and definition of technical architecture.

- Enable the creation of designs and frameworks for models and validate adherence to overall architecture.

- Technically lead software projects through all stages of the life cycle including requirements capture, design, development, and acceptance testing.

- Lead and direct the technical team to perform POCs for critical architectural decisions.

- Collaborate with client architect teams to complete architecture designs.

- Work with the BA team to groom technical requirements and validate system requirements.

- Create Solutioning HLD for new applications.

- Review code and provide guidelines to the technical lead.

Skills

Big Data, AWS, PySpark, Data Ingestion, Hadoop, Data Architect, SQL, Java, Kafka, Snowflake DB, Apache Airflow