Staff Software Engineer, TCGplayer

• A validated, successful track record of 5+ years with strong programming skills in either Java or Scala
• Comprehensive knowledge of Apache Spark’s internals, including Catalyst optimizer, Tungsten execution engine, shuffle mechanics, AQE, and memory management
• Solid understanding of file formats like Apache Parquet and table formats such as Apache Iceberg, Delta or Apache Hudi internals, including snapshots, manifests, partition specs, and table metadata
• Familiarity with Linux/Unix systems, including shell scripting and system commands
• Understanding of networking principles, as Hadoop often operates in distributed environments. Overall, the candidate is expected to have analytical skills to tackle complex distributed system challenges and optimize solutions
• Excellent problem solving and analytical skill on both defect and performance issue resolution
• Great teammate and able to work with a global team

Desirable

• We are part of the Analytics Data Platform Team within eBay, working with a mission towards improving availability, security, performance, tools and other features within Analytics Platform
• We are seeking an experienced Software Engineer with a strong background in Spark/Lakehouse table format technologies, responsible to build and optimize our next-generation lakehouse platform
• Our focus is on enhancing Spark stability/usability/performance and extending Iceberg's capabilities
• Additionally, we are building internal storage and metadata services to power our lakehouse architecture
• Troubleshoot and resolve production issues, ensuring minimal downtime
• Maintain and improve system monitoring, logging, and alerting