Software Engineer, Data Core

Description

Who We Are

The 4M story is likely one you haven’t heard before: We are on a mission to unlock access to the world below us, to do for the world below ground what Google Maps did for the world above. By leveraging cutting-edge technology, we are mapping the subsurface infrastructure to make reliable, real-time utility data accessible to the construction industry - completely transforming a traditional industry.

We’re a growing startup with 120 employees currently based in Tel Aviv, Israel, and Austin, Texas.

The Opportunity

We're seeking an experienced Software Engineer with a strong background to become an integral member of our Data-Core team, tasked with the mission of processing, structuring, and analyzing hundreds of millions of data sources. Your role will be pivotal in creating a unified, up-to-date, and accurate utilities map, services, and applications for accelerating our mapping operations. Your contributions will directly impact our core product's success.

Responsibilities

• Collaborate with cross-functional teams to design, build, and maintain data processing pipelines while contributing to our common codebase.
• Contribute to designing and implementing data architecture, ensuring effective data storage and retrieval.
• Develop and optimize complex Python-based applications and services to allow more efficient data processing and orchestration, enhancing the quality and accuracy of our datasets.
• Drive the scalability and performance optimization of data systems, addressing infrastructure challenges as data volume and complexity grow.
• Create and manage data infrastructure components, including ETL workflows, databases, supporting seamless data flow and accessibility.
• Design and implement CI/CD processes for data processing, model training, releasing, testing and monitoring, ensuring robustness and consistency.
• Implement geospatial data processing techniques and contribute to the creation of our unified utilities map, enhancing the product's geospatial features.

Requirements

• Bachelor's degree in Computer Science, Engineering, or related field.
• 4+ years of experience in software engineering with a focus on data systems.
• Proficiency in Python.
• Experience with big data technologies like Hadoop, Spark, or Kafka.
• Strong problem-solving skills and attention to detail.
• Familiarity with cloud platforms such as AWS, Google Cloud, or Azure.