Overview
Syllabus
intro
preamble
short bio
agenda
the rise of the generative ai/llm
new models are coming out at outstanding pace
llms have their issues - in fact, quite a lot of them...
popular use cases not exhaustive
business trends: let's use ai for everything!
actual systems go beyond just llms
which one to actually choose?
memory to self-host llm
quantization
simple chatbot case study
example: data protection / secure processing in amazon bedrock
small language models
entirely new attack vector
jailbreaks
indirect prompt injection from website
it can even happen from beyond the text...
recap: challenges
summarization: trends
beyond text modality...
moving even to voice interfaces area...
brace yourselves, regulations are coming
ethics and regulations
eu example - ai act
questions?
Taught by
Conf42