Data Engineer, Sinch

• Bachelor’s degree in Computer Science, Engineering, or a related field
• 3+ years of experience in building and maintaining mediation systems or data processing pipelines in a billing or transaction-heavy environment
• Hands-on experience with ETL tools (e.g., Apache NiFi, Airflow) and strong understanding of data transformation and enrichment processes
• Proficiency in event-driven processing technologies such as Apache Kafka, Flink, or Spark Streaming
• Strong programming skills in Python, Scala, or Java for developing data pipelines and processing logic
• Experience with cloud platforms such as AWS, GCP, or Azure for building scalable mediation systems (e.g., S3, Lambda, Glue)
• Proficiency in SQL and experience with both relational and NoSQL databases for managing and querying large datasets
• Strong analytical and problem-solving skills, with a focus on data accuracy and integrity
• Effective communication skills for collaborating with cross-functional teams, including technical and non-technical stakeholders
• Self-motivated, detail-oriented, and able to prioritize tasks in a fast-paced environment
• Strong organizational skills and ability to manage multiple mediation pipelines simultaneously

Desirable

• We are seeking a highly skilled Mediation Data Engineer to design, develop, and maintain data processing systems that collect, transform, and deliver usage data for billing and analytics platforms
• In this role, you will focus on building robust data mediation pipelines that process large volumes of transactional data, ensuring accurate and real-time integration into billing systems
• You will collaborate with teams across product, engineering, and finance to ensure smooth data flow, data quality, and compliance with industry standards
• Data Mediation Development: Design and implement mediation systems to collect, transform, and process raw usage data (e.g., call data records, messaging transactions) into standardized formats for billing and analytics platforms
• ETL Pipeline Creation: Build and maintain efficient ETL processes to process high volumes of usage data, ensuring data accuracy, consistency, and readiness for billing calculations
• Real-Time Event Processing: Develop and manage near real-time data pipelines using tools such as Kafka, Flink, or Spark Streaming, ensuring minimal latency between data ingestion and processing
• Data Transformation: Implement data transformation rules to normalize and enrich data from multiple sources, preparing it for accurate billing, invoicing, and reporting
• Automation and Efficiency: Automate mediation processes, minimizing manual intervention and improving the efficiency of data flows. Utilize orchestration tools like Apache Airflow or NiFi to manage workflows
• Data Integrity and Quality: Ensure data quality by implementing checks, monitoring systems, and error-handling mechanisms to prevent inconsistencies, duplicates, or data loss
• Collaboration with Stakeholders: Work closely with billing, product, and engineering teams to understand data requirements and ensure that mediation pipelines align with business needs
• Compliance and Governance: Ensure that all mediation processes adhere to data governance, security, and regulatory requirements, particularly in relation to billing data

• This role will be accepting applications until 11/13/2024 at a minimum
• Please note that the application timeline may be flexible to accommodate a comprehensive candidate evaluation