What is 21st Century Bicycle we’re talking about?
•Generative pre-trained transformer family of language models
• It is trained using a model of reinforcement learning from human
feedback
• We’re using version 3.5
• It was trained on text databases from the internet, 175 billion pieces
of information
• Version 4 was released last week!
Beijing Academy of Artificial Intelligence
1.5 billion parameters
175 billion parameters
178 billion parameters
280 billion parameters
580 billion parameters
1.2 trillion parameters
1.75 trillion parameters
x 500
100 billion neurons
1000 trillion synapses
Preparing
students for a
world with AI
Prompt tip Description Prompt Example
1 Resetting the Model Resetting the model can help generate
new and diverse responses.
"ignore all previous
prompts and..."
2 Topic Expertise ChatGPT can be asked to be an expert on a
specific topic.
“You are an expert in
physics, can you explain the
theory of relativity to me?"
3 Imitating a Writer You can prompt ChatGPT to write in the
style of a specific writer.
"Write a paragraph in the
style of Ernest
Hemingway."
4 Own Writing Style You can prompt ChatGPT to generate text
in your own writing style.
"Write a sentence using my
writing style."
Prompt tip Description Prompt Example
5 Semantic Similarity Using semantic similarity can help
generate more relevant responses.
"Generate a sentence that
has a similar meaning to 'I
am feeling happy today'."
6 Controlled
Generation
Controlled generation can help generate
responses that adhere to specific
constraints.
"Generate a list of three
adjectives that describe my
personality."
7 Novelty and
Creativity
Open-ended prompts can result in novel
and creative responses.
"Write a short story that
begins with the sentence
'The world had ended, but
for some reason, I was still
alive'."
8 Temperature Adjusting the temperature can help
control the level of creativity in the
generated responses.
"Generate a response to
the prompt 'What is the
meaning of life?' with a
temperature of 0.5."
Hallucination
• OpenAI acknowledged that
ChatGPT "sometimes writes
plausible-sounding but incorrect
or nonsensical answers
• As much as 15% of content
generated on GPT-3 could be
hallucinations
• GPT-4 rate is much lower
a data center circa 1975,
large mainframe
computers, reel to reel
tape drives, punch card
readers, men in black
suits sitting at dumb
terminals, photorealistic