Principal Data Engineer

Description :

- Strong understanding of best practices and standards for GCP application design and implementation.

- Three+ Year of hands-on experience with GCP platform and experience with many of the following components :

a. GCS, Cloud Run, Cloud Functions

b. Bigtable, Cloud SQL

c. Kafka, Pub/Sub

d. Python, Golang, Spark, Scala or Java

e. BigQuery, Dataflow, Data Fusion

f. GKE, CI/CD and Logging & Monitoring

- Understanding of Lambda Design Architectures and Real-Time Streaming

- Experience with Unstructured Data, Real-Time Streaming with GCP

- Ability to multitask and to balance competing priorities.

- Requires strong practical experience in agile application development, file systems management, and DevOps discipline and practice using short-cycle iterations to deliver continuous business value.

- Knowledge of all facets of GCP ecosystem development including ideation, design, implementation, tuning, and operational support.

- Ability to define and utilize best practice techniques and to impose order in a fast-changing environment. Must have strong critical thinking skills.

- Strong verbal, written, and interpersonal skills, including a desire to work within a highly matrixed, collaborative environment.

- A successful candidate may have :

a. Experience in Healthcare Domain

b. Experience in Patient Data

c. Experience with Natural Language Processing (NLP)

Hardware/Operating Systems :

- Linux, UNIX

- GCP

- Distributed, highly scalable processing environments.

Databases :

- NoSQL, Hbase, Cassandra, MongoDB, Cosmos, In-memory, Columnar, other emerging technologies

- Other Languages Java, Python, Scala, R

- Build Systems TFS, Github

- Ability to integrate tools outside of the core GCP ecosystem.

Certifications :

- GCP Cloud Professional Data Engineer

- GCP Cloud Professional Data Architect

Skills

Data Engineering, Google Cloud Platform, SQL, Kafka, Python, Scala, Linux, Distributed Systems, NoSQL