Senior Data Engineer

Prisma Photonics, a fast-growing startup, transforms infrastructure monitoring with optical fibers. We eliminate the need for extra sensors by offering sensor-free solutions to monitor electrical power grids and oil & gas pipelines across thousands of kilometers. Our fiber-sensing technology, integrated with AI and machine learning, enables our customers to achieve environmental and renewable energy targets, ensuring smooth utility operations on their path to net-zero emissions. We are looking for the best minds and spirits to join us in our journey. We know our product is only as great as the individuals building the hardware and software and harnessing data for good causes. Being a great team member means being eager to learn and grow, able to challenge while accepting being challenged, and working for the team and the product with enthusiasm and passion. We are now hiring a talented, self-driven and passionate Senior Data Engineer to build and maintain optimized and highly available data pipelines that facilitate deeper analysis and reporting. What you'll do Design data collection processes including textual and multi-dimensional data. Implement data searches and access APIs, between edge computing, cloud stack. Develop and optimize the data and metadata storage and databases for our AI and Algorithms to access train and test data efficiently. Analyze existing data schemes and processes, suggest and implement ways to improve them. Analyze cloud data usage and optimize cost structures while maintaining low latency access using common and proprietary services. Work closely with Software, AI and Algorithms teams on system integration, on-going data requests, data access and more. What you bring 5+ years of professional experience in Data Engineering or related roles, including hands-on experience designing and implementing data pipelines using orchestration frameworks such as Apache Airflow, Prefect, or similar tools. Experience with event-driven architectures and asynchronous messaging systems (e.g., Kafka, RabbitMQ). 5+ years of experience and a deep understanding of SQL and NoSQL databases (e.g., MySQL, Elasticsearch, MongoDB, PostgreSQL, ClickHouse). 5+ years of software development experience, including at least 2 years of hands-on experience with Python. Strong proficiency in version control systems (e.g., Git), containerization technologies (e.g., Docker), and CI/CD pipelines. Strong collaboration and communication skills, with the ability to work effectively across teams. An innovative mindset, a proactive approach to problem-solving, and a strong desire to learn and grow. Great to have Experience with streaming technologies, unstructured data, and diverse data types beyond traditional text and tabular data. Experience with distributed computing frameworks such as Hadoop, MapReduce, Apache Spark, or similar technologies. Experience working with Kubernetes-based systems. Experience with data visualization, monitoring, and analytics tools such as Grafana, the ELK Stack, Kibana, or similar platforms.