This presentation investigates several common production-ready architectures for RAG and discusses the pros and cons of each. At the end of this talk you will be able to help design RAG augmented LLM architectures that best fit your use case.
Read more
Large language models (LLMs) are powerful but demand significant resources, making them less ideal for smaller setups. Small language models (SLMs) are a practical, resource-efficient alternative, offering quicker deployment and easier maintenance. This article discusses the benefits and applications of SLMs, focusing on their efficiency, speed, robustness, and security in contexts where LLMs are not feasible.
Read more
In an insightful session presented by Enrico Rotundo, we explore the innovative approach to scaling StableAudio globally. This presentation sheds light on the synergy between NVIDIA Triton and AWS SageMaker.
Read moreRetrieval-Augmented Generation (RAG) improves Language Large Models (LLMs) by integrating external data through indexing, retrieval, and generation steps. This method allows LLMs to access up-to-date information and specific details, enhancing their applicability across various domains by providing more accurate, relevant responses and enabling real-time updates and domain-specific customization.
Read moreInterest in the use of large language models (LLMs) has ballooned in our recent AI consulting projects because they are applicable to a wide variety of AI problems. Our LLM consulting services help organizations determine the best approach for leveraging proprietary data. But most use cases require the use of proprietary data. What’s the best way of leveraging private or local data in LLMs?
Read moreThis article delves into the nuances of using large language models (LLMs) with large context windows, highlighting the benefits and challenges they present, from enhancing coherence and relevance to demanding more computational resources. Learn practical strategies for prompt design, maintaining narrative coherence, and utilizing attention mechanisms effectively.
Read moreIn this Webinar our CEO Phil Winder sat down with Javier Campos to discuss the EU AI Act. He is chief innovation officer at Fenestra, and is the author of “Grow Your Business with AI: A First Principles Approach for Scaling Artificial Intelligence in the Enterprise”, published by Apress.
Javier was involved in the development of the EU AI act, and was also involved in the development of the EU Cookie Law in the early 2010s.
Read moreThis is a video of a presentation introducing the EU AI Act by explaining what it is, how it impacts you, and what you need to do. In subsequent webinars I will delve into the details and provide specific examples. We will also be speaking to other industry experts to provide their insight.
Read moreThis article discusses the concept of token counts in large language models (LLMs) and their impact. Tokens are fragments of language used for text processing, representing words, parts of words, or punctuation marks. Code walkthroughs demonstrate how to calculate token counts and examples provide insight.
Read moreAn introduction to the challenge of fitting big data into the context windows of LLMs. In this second installment, discover the key strategies involved to improve your use of the context window. Subsequent articles will provide more examples.
Read more
