Testing and Evaluating Large Language Models in AI Applications

Published
Author
Dr. Phil Winder
CEO

With the rapidly expanding use of large language models (LLMs) in downstream products, the need to ensure performance and reliability is crucial. But with random outputs and non-deterministic behaviour how do you know if you application performs, or works at all? This webinar offers a comprehensive, vendor-agnostic exploration of techniques and best practices for testing and evaluating LLMs, ensuring they meet the desired success criteria and perform effectively across varied scenarios.

Read more

Retrieval-Augmented Generation (RAG) Examples and Use Cases

Published
Author
Dr. Phil Winder
CEO

Watch our webinar to explore Retrieval Augmented Generation (RAG) and its integration with Large Language Models (LLMs). Learn about RAG use cases, advanced LLM architectures, and techniques to enhance AI applications. Ideal for professionals utilizing or interested in RAG and LLM-powered systems.

Read more

Build a Voice-Based Chatbot with OpenAI, Vocode, and ElevenLabs

Published
Author
Natalia Kuzminykh
Associate Data Science Content Editor

Why might we want to make an LLM talk? The concept of having a human-like conversation with an advanced AI model is an interesting idea that has many practical applications. Voice-based models are transforming how we interact with technology, making interactions more natural and intuitive. By enabling AI to talk, we open the door to numerous practical applications, from accessibility to enhanced human-machine interactions. This guide explores how to create a voice-based chatbot using OpenAI, Vocode and ElevenLabs.

Read more

LLM Architecture: RAG Implementation and Design Patterns

Published
Author
Dr. Phil Winder
CEO

This presentation investigates several common production-ready architectures for RAG and discusses the pros and cons of each. At the end of this talk you will be able to help design RAG augmented LLM architectures that best fit your use case.

Read more

LLMs: RAG vs. Fine-Tuning

Published
Author
Dr. Phil Winder
CEO

Interest in the use of large language models (LLMs) has ballooned in our recent AI consulting projects because they are applicable to a wide variety of AI problems. But most use cases require the use of proprietary data. What’s the best way of leveraging private or local data in LLMs?

Read more

The Problem of Big Data in Small Context Windows (Part 2)

Published
Author
Dr. Phil Winder
CEO

An introduction to the challenge of fitting big data into the context windows of LLMs. In this second installment, discover the key strategies involved to improve your use of the context window. Subsequent articles will provide more examples.

Read more

ChatGPT from Scratch: How to Train an Enterprise AI Assistant

Published
Author
Dr. Phil Winder
CEO

This is a video of a presentation investigating how large language models are built and how to use them, inspired by our large language model consulting work. First presented at GOTO Copenhagen in 2023, the video investigates the history, the technology, and the use of large language models. The demo at the end is borderline cringe, but it’s a fun and demonstrates how you would fine-tune a language model on your proprietary data.

Read more
}