Software Engineer, Data Core
Description
Who We Are
The 4M story is likely one you haven’t heard before: We are on a mission to unlock access to the world below us, to do for the world below ground what Google Maps did for the world above. By leveraging cutting-edge technology, we are mapping the subsurface infrastructure to make reliable, real-time utility data accessible to the construction industry - completely transforming a traditional industry.
We’re a growing startup with 120 employees currently based in Tel Aviv, Israel, and Austin, Texas.
The Opportunity
We're seeking an experienced Software Engineer with a strong background to become an integral member of our Data-Core team, tasked with the mission of processing, structuring, and analyzing hundreds of millions of data sources. Your role will be pivotal in creating a unified, up-to-date, and accurate utilities map, services, and applications for accelerating our mapping operations. Your contributions will directly impact our core product's success.
Responsibilities
- Collaborate with cross-functional teams to design, build, and maintain data processing pipelines while contributing to our common codebase.
- Contribute to designing and implementing data architecture, ensuring effective data storage and retrieval.
- Develop and optimize complex Python-based applications and services to allow more efficient data processing and orchestration, enhancing the quality and accuracy of our datasets.
- Drive the scalability and performance optimization of data systems, addressing infrastructure challenges as data volume and complexity grow.
- Create and manage data infrastructure components, including ETL workflows, databases, supporting seamless data flow and accessibility.
- Design and implement CI/CD processes for data processing, model training, releasing, testing and monitoring, ensuring robustness and consistency.
- Implement geospatial data processing techniques and contribute to the creation of our unified utilities map, enhancing the product's geospatial features.
- Bachelor's degree in Computer Science, Engineering, or related field.
- 4+ years of experience in software engineering with a focus on data systems.
- Proficiency in Python.
- Experience with big data technologies like Hadoop, Spark, or Kafka.
- Strong problem-solving skills and attention to detail.
- Familiarity with cloud platforms such as AWS, Google Cloud, or Azure.