Machine Learning Solutions Architect, Databricks
Unified cloud platform for big data
Job no longer available
Unified cloud platform for big data
1001+ employees
Job no longer available
1001+ employees
Company mission
To make big data simple for the enterprise.
Role
Who you are
- This position is a senior level, customer-facing role that requires deep hands-on expertise in Apache SparkTM and Machine Learning, along with a breadth of knowledge of the big data ecosystem
- A successful Machine Learning Solutions Architect is curious, self-motivated, and excels in cross-functional collaboration
- Design and implementation experience in Big Data technologies (Spark, Hadoop ecosystem, Kafka, NoSQL databases) and familiarity with data architecture patterns (data warehouse, data lake, streaming, Lambda/Kappa architecture)
- Familiarity with the full range of the machine learning space, both the mathematical and statistical theory and the technical applications of these methods
- Experience with building and deploying a range of machine learning models into production, including supervised and unsupervised machine learning and deep learning methods
- Experience with performance tuning, troubleshooting, and debugging Spark and/or other big data solutions
- Comfortable with talking up and down the IT chain of command including directors, managers, architects and developers
- Expertise programming in Python or Scala
- Experience with cloud providers such as AWS, Azure or GCP
- Willing to travel 30-40% regionally
What the job involves
- As a Machine Learning Solutions Architect at Databricks, you will have the opportunity to shape the future big data and the machine learning landscape for leading Fortune 500 organizations
- You will strategically guide our largest customers, lead their architecture design, and implement pipelines from data engineering through model building and deployment
- As part of joining Databricks, you will have a direct channel to the developers of Apache Spark, Delta Lake, and MLflow, and the opportunity to attend and present at top big data conferences
- Guide strategic customers as they design and implement big data and machine learning projects, ranging from business transformational projects, through to end-to-end machine learning model build and deployment
- Leverage your deep expertise in building machine learning products to guide customers to do the same, through building proofs of concept and prototypes, architecting solutions and even pair-programming with customer teams as necessary
- Architect, implement, and/or validate migration of workloads from 3rd party databases and data platforms to Apache Spark
- Evangelize Spark and Databricks, Delta Lake and MLflow across developer community through meetups and conferences
- Plan and coordinate with Account Executives, Customer Success Engineers and Solution Architects for expanding the use of Databricks platform within strategic enterprise customers on a weekly basis
Our take
Open source data management tools are not easy to use, and Databricks offers each of these tools on a centralised platform in the form of SaaS. The company mitigates all previous management headaches associated with using these tools.
Databricks is one of the fastest growing cloud enterprise software companies on record. Through smart features like its notebooks and by sitting on top of open-source tools like Azure and AWS, the company is able to maximise the production capabilities and security of these platforms, turning its service into an even better tool.
Databricks next moves include plans to move public. As the company has many institutional investors, including BlackRock, when it sets out for a likely IPO it is going to have a great head start. Further, a recent product release that allows for the interaction of curated data alongside unstructured data places Databricks in a strong position against major competitors like BigQuery and Snowflake.
Kirsty
Company Specialist at Welcome to the Jungle
Insights
81% employee growth in 12 months
Company
Funding (last 2 of 8 rounds)
Aug 2021
$1.6bn
SERIES H
Feb 2021
$1bn
SERIES G
Total funding: $3.5bn
Leadership
Dr Ali Ghodsi
(CEO)Gained a PhD in Computer Science before spending 10 years at UC Berkeley as an Adjunct Professor, a role Ghodsi still holds.
Ion Stoica
(Co-founder & Chairman)Previously a researcher at Berkley in Cloud Computing, Distributed Systems and Big Data.
Share this job