What is Generative AI?

& Some Definitions

Illustrating Reinforcement Learning from Human Feedback (RLHF)

Talking to AI might be the most important skill of this century - The…

What is generative AI?Generative artificial intelligence (AI) describes algorithms (such as ChatGPT) that can be used to create new content, including audio, code, images, text, simulations, and videos. Recent new breakthroughs in the field have the potential to drastically change the way we approach content creation.

Test de Turing — Wikipédia

AI for product managers: Today’s top terms to stay in the knowGaining a basic understanding of newer AI terminology is critical for any field, including product management. This guide will serve as an entry point into the current key AI terminology to know now.

How ChatGPT actually worksSince its release, the public has been playing with ChatGPT and seeing what it can do, but how does ChatGPT actually work? While the details of its inner workings have not been published, we can piece together its functioning principles from recent research.

What Is a Transformer Model?Transformer models apply an evolving set of mathematical techniques, called attention or self-attention, to detect subtle ways even distant data elements in a series influence and depend on each other.

Generative Tech BeginsCalling it Generative AI is only half the equation. Generative Tech is a major shift - a whole new era of human-machine collaboration.

Everything You Ever Wanted to Know About Artificial IntelligenceSupersmart algorithms won't take all the jobs, But they are learning faster than ever, doing everything from medical diagnostics to serving up ads.

lecun-20230324-nyuphil.pdf

For those of you interested to hear a different opinion about LLM and to understand why, have a look at this presentation from: Yann Le Cun (Chief AI Scientist at Meta) : he is bold and not popular in his affirmation: "Auto-Regressive LLMs are doomed. They cannot be made factual, non-toxic, etc. They are not controllable Probability e that any produced token takes us outside of the set of correct answers"... He backs it up with a scientific analysis of the models and proposes a Cognitive Architecture

capable of reasoning & planning. Here is his public deck presented at NYU. Interesting and understandable demonstration.

What Are Word and Sentence Embeddings?Sentence and word embeddings are the bread and butter of language models. Here is a very simple introduction to what they are.

Finetuning LLMs Efficiently with AdaptersWhy Finetuning LLMs? Large language models (LLMs) like BERT, GPT-3, GPT-4, LLaMA, and others are trained on a large corpus of data and have general knowledge. However, they may not perform as well on specific tasks without finetuning. For example, if you want to use a pretrained LLM for analyzing legal or medical documents, finetuning it on a corpus of legal documents can significantly improve the model's performance. (Interested readers can find an overview of different LLM finetuning methods in my previous article,

Page updated

Google Sites

Report abuse