Winder.AI Blog

Industrial AI insight about machine learning, reinforcement learning, MLOps, and more...

Subscribe

GitOps for Machine Learning Projects

GitOps for Machine Learning Projects

Fri Mar 11, 2022, by Phil Winder, in MLOps, Software Engineering

Not so long ago, developers used clunky consoles to provision infrastructure and applications. It wasn’t long before someone realized it was better to automate such a process via scripts and APIs. But it wasn’t until Hashicorp showed that APIs were not enough. Their insight was to declare a canonical representation of the infrastructure. You can then reconcile this declaration against the live view of the infrastructure. In 2015-16 we helped WeaveWorks develop their cloud monitoring platform.

Machine Learning Presentation: Provenance and Lineage for Data, Pipelines, and Deployments

Machine Learning Presentation: Provenance and Lineage for Data, Pipelines, and Deployments

Wed Feb 16, 2022, by Phil Winder, in Machine Learning, Talk

Dr. Phil Winder shares experiences of Winder.AI’s machine learning consulting experience at a variety of large and small organizations. Abstract In this talk he focuses on how provenance and lineage, typically thought of as a model deployment problem, can help make the development of machine learning models more repeatable, understandable, and robust. Discover the difference between lineage and provenance. Learn how to determine the “strength” of your lineage and how robust it is to failure.

Databricks vs Pachyderm - A Data Engineering Comparison

Databricks vs Pachyderm - A Data Engineering Comparison

Mon Feb 7, 2022, by Enrico Rotundo, Hajar Khizou, Phil Winder, in MLOps, White Paper

Winder.AI has conducted a study comparing the differences between Pachyderm and Databricks. Both vendors are prominent in the data and machine learning (ML) industries. But they offer different products targeting different use cases. Modern, production-ready requirements present major challenges where data is evolving, unstructured, and big. This white paper investigates the strengths and weaknesses in their respective propositions and how they deal with these challenges.

Reinforcement Learning Presentation: Cyber Security

Reinforcement Learning Presentation: Cyber Security

Wed Jan 19, 2022, by Phil Winder, in Reinforcement Learning, Talk

Dr. Phil Winder shares experiences of Winder.AI’s reinforcement learning consulting experience at a variety of large and small organizations. Abstract In this talk he focuses on RL applications, looking at the use of RL in cyber security and discusses one interesting case study about how Winder.AI helped an internal security team develop a tool to hack web application firewalls. About This Series Welcome to Winder.AI talks. A series of free interactive webinars hosted by Dr Phil Winder, CEO of Winder.

MLOps Presentation: How to Build Resilient AI With GitOps

MLOps Presentation: How to Build Resilient AI With GitOps

Wed Jan 12, 2022, by Phil Winder, in MLOps, Talk

Dr. Phil Winder shares experiences of Winder.AI’s MLOps consulting experience at a variety of large and small organizations. Abstract In this talk he focuses on how GitOps is a key ingredient in any ML platform to enhance resiliency and observability. Learn why it is important, what it involves, and how to implement it in this short 30 minute video. About This Series Welcome to Winder.AI talks. A series of free interactive webinars hosted by Dr Phil Winder, CEO of Winder.

The Value of a Machine Learning Pipeline: Past, Present, and the Future of MLOps With Kubeflow

The Value of a Machine Learning Pipeline: Past, Present, and the Future of MLOps With Kubeflow

Mon Nov 1, 2021, by Phil Winder, in Machine Learning, MLOps

Industrial machine learning consulting projects come in a variety of forms. Sometimes clients ask for exploratory data analysis, to evaluate whether their data can be used to help solve a problem using artificial intelligence. Other times we use machine learning (ML) algorithms to automate decisions and improve efficiencies within a business or product. More recently we’ve refocused on reinforcement learning and customers ask us to help control some complex multi-step process.

Using Reinforcement Learning to Attack Web Application Firewalls

Using Reinforcement Learning to Attack Web Application Firewalls

Fri Sep 3, 2021, by Phil Winder, in Reinforcement Learning, Case Study

Introduction Ideally, the best way to improve the security of any system is to detect all vulnerabilities and patch them. Unfortunately this is rarely possible due to the extreme complexity of modern systems. One primary threat are payloads arriving from the public internet, with the attacker using them to discover and exploit vulnerabilities. For this reason, web application firewalls (WAF) are introduced to detect suspicious behaviour. These are often rules based and when they detect nefarious activities they significantly reduce the overall damage.

Helping Modzy Build an ML Platform

Helping Modzy Build an ML Platform

Wed Aug 25, 2021, by Phil Winder, in MLOps, Case Study

Winder.AI collaborated with the Modzy development team and MLOps Consulting to deliver a variety of solutions that make up the Modzy product, a ModelOps and MLOps platform. A summary of this work includes: Developing the Open Model Interface Open-sourcing chassis, the missing link that allows data scientists to build robust ML containers Model monitoring and observability product features MLOps and model management product features The Problem: How to Build An ML Platform Modzy’s goal is to help large organizations orchestrate and manage their machine learning (ML) models.

How To Build a Robust ML Workflow With Pachyderm and Seldon

How To Build a Robust ML Workflow With Pachyderm and Seldon

Tue Jul 27, 2021, by Enrico Rotundo, in MLOps, Case Study

This article outlines the technical design behind the Pachyderm-Seldon Deploy integration available on GitHub and is intended to highlight the salient features of the demo. For an in depth overview watch the accompanying video on YouTube. Introduction Pachyderm and Seldon run on top of Kubernetes, a scalable orchestration system; here I explain their installation process, then I use an example use case to illustrate how to operate a release, rollback, fix, re-release cycle in a live ML deployment.

How We Built an MLOps Platform Into Grafana

How We Built an MLOps Platform Into Grafana

Fri Jun 11, 2021, by Phil Winder, in MLOps, Case Study

Winder.AI collaborated with Grafana Labs to help them build a Machine Learning (ML) capability into Grafana Cloud. A summary of this work includes: Product consultancy and positioning - delivering the best product and experience Design and architecture of MLOps backend - highly scalable - capable of running training jobs for thousands of customers Tight integration with Grafana - low integration costs - easy product enablement Grafana’s Need - Machine Learning Consultancy and Development Grafana Cloud is a successful cloud-native monitoring solution developed by Grafana Labs.