MuleSoft + Augmented Reality & ChatGPT

1. MuleSoft +
Augmented Reality &
ChatGPT
Sat, Apr 15, 10:00 AM (IST)

2. 2
Bangalore Mysore
Augmented Reality
X
MuleSoft
presents
ChatGPT

3. Agenda
● Introductions
o What is Augmented Reality?
o Future of Augmented Reality?
o Types of AR
o MuleSoft + AR
o ChatGPT with MuleSoft
● Demo
3

4. Organizer’s
Bharath Kumar NJ,
AMTS, Salesforce
Shubham Chaurasia,
Professional Integration
Developer, Billennium
Giridhar Meka,
Sr. Technical Architect,
HashedIn by Deloitte
Nitish Jain
Application Developer,
Accenture

5. Safe Harbour Statement
● Both the speaker and the host are organizing this meet-up in individual capacity only.
We are not representing our companies here.
● This presentation is strictly for learning purposes only.
● Organizer/Presenter do not hold any responsibility that same solution will work for
your business requirements.
● This presentation is not meant for any promotional activities.
5

6. A recording of this meetup will be uploaded to events page within 24 hours.
Questions can be submitted/asked at any time in the Chat/Questions & Answers Tab.
Make it more Interactive!!!
Give us feedback! Rate this meetup session by filling feedback form at the end of the day.
We Love Feedbacks!!! Its Bread & Butter for Meetup.
Housekeeping
6

7. About the Speaker:
Introductions
Vaibhav Bahety,
MuleSoft Developer,
HashedIn by Deloitte
7
Angadh Srivastava,
MuleSoft Developer,
HashedIn by Deloitte
Shubham Chaurasia,
Professional Integration
Developer, Billennium

8. Augmented Reality
X
MuleSoft

9. A SHOW OF HANDS:
How Many Potterheads here?

10. Augmented Reality turns the environment around you into a digital interface by placing virtual
objects in the real world, in real-time. The virtual objects can be interacted in real time.
What is Augmented Reality?
10

11. Future of AR
11
Gaming
Social Media
Filters
AR Maps Advertisement Shopping

12. SDK’s used for AR Development
12
Vuforia AR Core Wikitude
AR kit

13. Marker Based Augmented Reality
13
Marker-based augmented reality (also called Image Recognition) uses a camera and
some type of visual marker, such as a QR/2D code, called as image target to produce
a result only when the marker is sensed by a reader.
Image Target Image Target Feature

14. Marker Less Augmented Reality
14
As one of the most widely implemented applications of augmented reality, marker less
(also called location-based, position-based or GPS) augmented reality, uses a GPS, digital
compass ,accelerometer which is embedded in the device to provide data based on your
location.
❑ Ground Plane Detection
❑ Mid Air Plane Detection

15. What role MuleSoft can play in
future of Augmented Reality ?

16. DEMO

17. Demo APK Download

18. Product Updates

19. Product Updates
● Anypoint Code Builder - Beta
● API Experience Hub - Beta
● Anypoint Flex Gateway v1.4.3
● CloudHub 2.0
a. Non-HTTP Protocol Support (TCP, UDP, etc.)
b. VPC to Private Space upgrade
● Training material to Trailhead
● MuleSoft Ideas portal to Salesforce IdeasExchange

22. ● ChatGPT is a state-of-the-art natural language processing (NLP) model developed
by OpenAI.
● It is a variant of the popular GPT-3 (Generative Pre-trained Transformer 3) model,
which has been trained on a massive amount of text data to generate human-like
responses to a given input.
● ChatGPT is its ability to generate responses that are consistent with the context of
the conversation
● ChatGPT is also capable of performing a range of other NLP tasks, such as
language translation, text summarisation, and sentiment analysis
● Unlike traditional NLP models that rely on hand-crafted rules and manually labeled
data, ChatGPT uses a neural network architecture and unsupervised learning to
generate responses
What is ChatGPT

23. ChatGPT vs ChatGPT Plus
● ChatGPT Plus had a
Turbo mode that was
faster than the one
we have in the free
plan
● Access to GPT-4
● Training Data: ChatGPT is trained on a large corpus of text data, while ChatGPT+ is
trained on an even larger and more diverse dataset, including more languages and
more varied types of text.
● Model Size: ChatGPT+ has a larger model size, meaning it has more parameters and
can capture more complex relationships between words and concepts.
● Training Techniques: ChatGPT+ uses more advanced training techniques, such as
curriculum learning and mixup, to further improve its performance.

24. ChatGPT 3.5 vs ChatGPT 4
● It defines parameters as “the parts of a large language model that define its skill
on a problem such as generating text.” It’s essentially what the model learns.
GPT-1 had 117 million parameters to work with, GPT-2 had 1.5 billion, and GPT-
3(Opens in a new window) arrived in February of 2021 with 175 billion
parameters. By the time ChatGPT was released to the public in November 2022,
the tech had reached version 3.5
● GPT-3.5 is a text-to-text model, GPT-4 is more of a data-to-text model
● GPT-4 has a longer memory than previous versions The more you chat with a bot
powered by GPT-3.5, the less likely it will be able to keep up, after a certain point
(of around 8,000 words). GPT-4’s short-term memory is closer to 64,000 words.
GPT-4 can even pull text from web pages when you share a URL in the prompt.
● GPT-4 accepts images as part of a prompt. It can even explain why memes are
funny.

25. Limitations of ChatGPT
● It is a large and complex model, which makes it resource-intensive to run
● It is a generative model, which means that it is not always able to provide accurate
answers to specific questions
● Like all NLP models, is limited by the quality and quantity of the data it has been
trained on
● The model is not yet able to ask clarifying questions when user input is ambiguous
and instead tries to guess user intent
● Its resource-intensive nature and potential for irrelevant or nonsensical responses
make it less than ideal for certain applications

26. Use OpenAI
ChatGPT

27. OpenAI ChatGPT

28. Introduction to
ChatGPT API

29. ChatGPT API
● Completions:- Given a prompt, the model will return one or more predicted
completions, and can also return the probabilities of alternative tokens at each
position.
● Models:- List and describe the various models available in the API. Understand what
models are available and the differences between them
● Chat:- Given a chat conversation, the model will return a chat completion response.
● Images:- Given a prompt and/or an input image, the model will generate a new
image.
● Audio:- Learn how to turn audio into text
● The OpenAI API uses API keys for authentication. Check API Keys page to retrieve
the API key you'll use in your requests.
● The API is priced at $0.002 per 1K tokens. You have free credit to use, though

30. MuleSoft Integration
with ChatGPT API

31. ChatGPT API Messages
● Messages must be an array of message objects, where each object has a role (either
"system", "user", or "assistant") and content (the content of the message).
Conversations can be as short as 1 message or fill many pages.
● Typically, a conversation is formatted with a system message first, followed by
alternating user and assistant messages.
● The system message helps set the behavior of the assistant.
● messages=[
● {"role": "system", "content": "You are a helpful assistant."},
● {"role": "user", "content": "Who won the world series in 2020?"},
● {"role": "assistant", "content": "The Los Angeles Dodgers won the World Series in
2020."},
● {"role": "user", "content": "Where was it played?"}
● ]

32. DEMO

33. Thank you