SlideShare a Scribd company logo
2023 (1)
Carlos J. Costa (ISEG)
GENERATIVE AI: CHALLENGES
AND IMPLICATIONS
Moderator: Prof. Carlos J. Costa, ISEG
2023 (2)
Carlos J. Costa (ISEG)
Index
• Presentation of the moderator
• Generative AI
• LLM
• ChatGPT
• Bard
• Generative AI Ecosystem
• Challenges and Implications
2023 (3)
Carlos J. Costa (ISEG)
Carlos J. Costa
Associate Professor with Habilitation
• Chat-GPT Task Force @ ISEG
• Costa, C. (2023 Jan. 6) “GPT-3 e a utilização de Inteligencia Artificial no Ensino”.
isegtech.blogs.sapo. https://isegtech.blogs.sapo.pt/gpt-3-e-a-utilizacao-de-ia-no-
ensino-7355
• Costa, C. (2023 Jul. 16) “Bard: Finalmente em Portugal”. isegtech.blogs.sapo.
https://isegtech.blogs.sapo.pt/bard-finalmente-em-portugal-8321
2023 (4)
Carlos J. Costa (ISEG)
Generative AI
• Generative artificial intelligenceincludes
models that can generate new content,
such as images, music, and text.
• An example of these models is ChatGPT.

Recommended for you

GENERATIVE AI, THE FUTURE OF PRODUCTIVITY
GENERATIVE AI, THE FUTURE OF PRODUCTIVITYGENERATIVE AI, THE FUTURE OF PRODUCTIVITY
GENERATIVE AI, THE FUTURE OF PRODUCTIVITY

Discuss the impact and opportunity of using Generative AI to support your development and creative teams * Explore business challenges in content creation * Cost-per-unit of different types of content * Use AI to reduce cost-per-unit * New partnerships being formed that will have a material impact on the way we search and engage with content Part 4 of a 9 Part Research Series named "What matters in AI" published on www.andremuscat.com

aiartificial intelligenceintelligence
Using the power of Generative AI at scale
Using the power of Generative AI at scaleUsing the power of Generative AI at scale
Using the power of Generative AI at scale

In this session, you'll get all the answers about how ChatGPT and other GPT-X models can be applied to your current or future project. First, we'll put in order all the terms – OpenAI, GPT-3, ChatGPT, Codex, Dall-E, etc., and explain why Microsoft and Azure are often mentioned in this context. Then, we'll go through the main capabilities of the Azure OpenAI and respective usecases that might inspire you to either optimize your product or build a completely new one.

openaichatgptazure openai
Leveraging Generative AI & Best practices
Leveraging Generative AI & Best practicesLeveraging Generative AI & Best practices
Leveraging Generative AI & Best practices

In this event we will cover: - What is Generative AI and how it is being for future of work. - Best practices for developing and deploying generative AI based models in productions. - Future of Generative AI, how generative AI is expected to evolve in the coming years.

#uipathcommunity#rpa#ai
2023 (5)
Carlos J. Costa (ISEG)
LLM
• A large language model (LLM) is a type of
language model characterized by its ability
to achieve general-purpose language
processing and generation.
2023 (6)
Carlos J. Costa (ISEG)
ChatGPT
• Conversational generative artificial
intelligence chatbot
• LLM-based chatbot
• developed by OpenAI
• Launched on November 30, 2022,
• Generative, Pre-Trained, Transformer
Name
Release
date Developer Number of parameters Corpus size
Training cost
(petaFLOP-day) License
GPT-2 2019 OpenAI 1.5 billion
40GB[103] (~10 billion
tokens) MIT
GPT-3 2020 OpenAI 175 billion 300 billion tokens 3640proprietary
GPT-4 March 2023 OpenAI Exact number unknow Unknown proprietary
2023 (7)
Carlos J. Costa (ISEG)
Google Bard
• Conversational generative artificial
intelligence chatbot
• Developed by Google,
• Based initially on the LaMDA family of
large language models (LLMs) and later
the PaLM LLM.
Name Release date Developer
Number of
parameters Corpus size
Training cost
(petaFLOP-day) License
BERT 2018 Google 340 million 3.3 billion words 9Apache 2.0
XLNet 2019 Google ~340 million 33 billion words Apache 2.0
GLaM (Generalist Language Model) December 2021 Google 1.2 trillion 1.6 trillion tokens 5600proprietary
Minerva June 2022 Google 540 billion 38.5B tokens from webpages proprietary
LaMDA (Language Models for Dialog Applications) January 2022 Google 137 billion 1.56T words, 168 billion tokens 4110proprietary
PaLM (Pathways Language Model) April 2022 Google 540 billion 768 billion tokens 29250proprietary
PaLM 2 (Pathways Language Model 2) May 2023 Google 340 billion 3.6 trillion tokens 85000proprietary
2023 (8)
Carlos J. Costa (ISEG)
Generative AI Ecosystem
2023 (9)
Carlos J. Costa (ISEG)
Generative AI Ecosystem
Other services:
• Chat PDF https://www.chatpdf.com/
• ChatGPT https://chat.openai.com/
• Chatsonic https://app.writesonic.com/
• Consensus https://consensus.app/
• Elicit https://elicit.org/
• Google Bard https://bard.google.com/
• Microsoft Bing Chat (no Edge) https://www.bing.com/
• Research Rabit https://www.researchrabbit.ai/
• SciCite https://scite.ai/
• SciSpace https://typeset.io/
• SciStyle https://www.scistyle.com/
• You.com https://you.com/
2023 (10)
Carlos J. Costa (ISEG)
Generative AI Ecosystem
• GPT4ALL
(https://gpt4all.io) allows to
run locally many pretrained
models
2023 (11)
Carlos J. Costa (ISEG)
Generative AI Ecosystem
• FreedomGPT
(https://www.freedomgpt.com)
• 100% uncensored and private AI chatbot.
• ALPACA and LLAMA models
2023 (12)
Carlos J. Costa (ISEG)
Challenges and Implications
• Education
• Research
• Software development
• Creative industries
• Manufacturing
• Cybersecurity
• Client Support
• Health care

More Related Content

Generative AI

Editor's Notes

  1. deep learning architecture that relies on the parallel multi-head attention mechanism
  2. deep learning architecture that relies on the parallel multi-head attention mechanism