Technical Software Lead, Aviatrix Systems

• 10+ years of software development in building large-scale Data Analytics solutions
• 3+ years of hands-on engineering leadership
• Proficiency in Golang (preferred) or Python
• Proficiency with common telemetry frameworks (Prometheus, Open Telemetry)
• Proficiency with big data pipeline technologies (g., Logstash, FluentD, Kafka, Spark, Hadoop, Storm, Spark, Flink)
• Domain knowledge in networking: (OSI stack, BGP, IP, TCP, UDP, HTTP, DNS; Linux network stack, SDN, network automation)
• Experience with ML libraries (Scikit-learn, Pytorch, Tensorflow or Keras)
• Experience with Cloud Platforms a plus
• BS in Computer Science, Software Engineering, Machine Learning, Mathematics, Statistics, or equivalent

Desirable

• As a Principal Technical Lead (TL), you will lead a small team of talented collaborative software engineers focused on developing and implementing robust and scalable systems to collect, process and analyze network data
• In this role, you will shape, design, and build innovative new data pipelines of that scale. You will have an opportunity to make a significant impact because there is a short time-to-market cycle, and your code will be touched by every Aviatrix enterprise customer
• Architecture/Design: You will be responsible for designing and architecting the data pipeline infrastructure needed for network analytics including data collection, storage, and processing components to ensure scalability, reliability, and performance of the pipeline
• Collection Data: You will lead and coordinate with other engineers to identify and collect relevant data from network devices, such as routers, switches, and firewalls
• Data Processing: You will lead and develop algorithms, processes to transform and cleanse the raw network data. This may involve parsing, normalizing, aggregating, and enriching the data to make it suitable for analysis
• Integration with Analytics Tools: You will have expertise in integrating the data pipeline with various analytics tools and platforms such as data visualization tools and ML
• Performance Optimization: You will be responsible for optimizing the data pipeline to handle large volumes of network data efficiently, minimizing latency and maximizing throughput. This may involve parallel processing, distributed computing and leveraging cloud
• Quality Control – you will be responsible for implementing data quality checks and validation mechanisms to ensure the accuracy, consistency and completeness of the network data flowing through the pipeline
• Monitoring and Maintenance – you will lead in setting up monitoring tools and techniques to monitor the health and performance of the data pipeline
• Collaboration and Leadership – as the Technical Software Lead, you will work closely with cross–functional team