Senior Software Engineer, Competera

Scraping

Salary not provided

AWS

Kubernetes

GCP

Python

Kafka

Redis

Sentry

Selenium

Prometheus

Grafana

BigQuery

Scrapy

Playwright

FastAPI

Senior and Expert level

Remote from Germany

Dynamic pricing platform for retailers

Job no longer available

Dynamic pricing platform for retailers

21-100 employees

B2BArtificial IntelligenceMarketplaceBig dataAnalyticsMachine LearningSaaSAutomation

Job no longer available

Salary not provided

AWS

Kubernetes

GCP

Python

Kafka

Redis

Sentry

Selenium

Prometheus

Grafana

BigQuery

Scrapy

Playwright

FastAPI

Senior and Expert level

Remote from Germany

21-100 employees

B2BArtificial IntelligenceMarketplaceBig dataAnalyticsMachine LearningSaaSAutomation

Company mission

To free retailers from pricing routine and save their time for more meaningful things.

Job

Company

Role

Who you are

5+ years of experience as a Software Engineer with a strong track record in web scraping
Proven expertise in Python and relevant libraries like Scrapy, Selenium, Pyppeteer, Playwright
In-depth understanding of web protocols and how modern web works (SSL, proxies, cookies, headers, browsers)
Experience with anti-scraping detection and bypass techniques
Experience with Kafka, Redis, and microservices architecture
Familiarity with Domain-Driven Design (DDD) principles
Eng - interm +
Ability to lead and mentor junior engineers in overcoming technical challenges
Proactive approach to identifying and solving problems, seeking out new opportunities
Ability to work independently and as part of a team in a fast-paced environment
Ability to learn new technologies and adapt to changing web scraping landscapes

Desirable

Experience with cloud platforms like AWS or GCP
Experience with data quality and cleaning techniques
Knowledge of machine learning and data analysis techniques

What the job involves

In Competera, we are building a place where optimal pricing decisions can be made easily. We believe that AI technologies will soon drive all challenging decisions and are capable of helping humans be better. We are now looking for a Senior Software Engineer (Scraping) to take ownership over Data Delivery engineering growth and direction
Programming Languages: Python
Tech Stack: PostgreSQL, asyncio, FastAPI, Apache Kafka, ClickHouse, BigQuery, GCS, Scrapy, Selenium, Pyppeteer
Infrastructure: Kubernetes, Helm, ArgoCD, Grafana, Prometheus, Sentry, OpsGenie
Design and implement scalable and efficient services for a web scraping system using Python and relevant libraries
Lead the development team in overcoming anti-scraping measures such as CAPTCHAs, rate limiting, and dynamic content loading
Mentor and guide junior engineers in the team, fostering their growth and development
Automate existing scraper development processes using tools and frameworks to improve efficiency and maintainability
Monitor system performance and proactively identify and address any issues
Design and implement microservices architecture for modularity and scalability
Apply Domain-Driven Design (DDD) principles to ensure clean and maintainable code
Stay up-to-date with the latest advancements and best practices in web scraping

Our take

Traditional retail pricing is often inefficient, relying on manual processes and outdated data. This struggle to find the right price can lead to lost customers and revenue, and margin erosion, leaving retailers frustrated and in search of a better solution.

Competera's AI-powered price optimization platform provides real-time market data, automated rules, and recommendation engines. Its algorithms analyze over 20 factors, including competitor behavior, promotions, and demand trends, to suggest optimal prices. This data-driven approach helps retailers maximize profits while considering market dynamics and customer preferences.

Raising funding back in 2024, Competera has focussed on enhancing its AI capabilities, broadening its service offerings and scaling up its operations. This leaves the company well-positioned to capture a significant share of the retail pricing market as it moves forward.

Kirsty

Company Specialist at Welcome to the Jungle

Company

Funding (last 2 of 8 rounds)

Apr 2024

$0.3m

SEED

Jan 2024

$3m

SEED

Total funding: $8.3m

Company benefits

Meaningful work in an agile team ever-open to the experiments
Fair payout with regular performance-based reviews
Remote-first ideology: freedom to operate from the home office
Working hours that adapt to your biorhythm and no time tracking systems on
Want to learn? Competera loves that and is eager to cover 70% of your training/course fee
Paid vacation & sick leaves (20 business days each) + 15 days off
Partial medical insurance coverage

Company HQ

East New York, NY

Leadership

Alex Galkin

(CEO & Founder)

A Mentor at Founder Institute and Startup Wise Guys. Previously co-founded PGP Innovative Consulting and Artais and also served as the CEO of Razzom.

Share this job