An introduction to the challenge of fitting big data into the context windows of LLMs. Part 1 introduces the problem and why it exists. Part 2 will provide an overview of the strategies to overcome this problem.
Read moreThis is a video of a presentation investigating how large language models are built and how to use them, inspired by our large language model consulting work. First presented at GOTO Copenhagen in 2023, the video investigates the history, the technology, and the use of large language models. The demo at the end is borderline cringe, but it’s a fun and demonstrates how you would fine-tune a language model on your proprietary data.
Read moreThis notebook demonstrates how to fine-tune a state-of-the-art large language model (LLM) on a single GPU. This example uses Falcon-7B because it is Apache licensed. The data used in this notebook is for informational purposes only, do not use this data unless you have licensed it.
Read moreWe’re pleased to announce the release of Stable Audio, a new generative AI music service. Stable Audio is a collaboration between Stability AI and Winder.AI that leverages state-of-the-art audio diffusion models to generate high-quality music from a text prompt.
Read more
