Sam Frish: MR molecular game for scientists More info about UA Online GameDev Marathon - http://lembs.com/gdmarathon

1. Molecular MR Multiplayer: a cross-platform collaborative interactive game for
scientists

2. Sam Frish
SoftServe Inc.,
Lviv, Ukraine
sfrish@softserveinc.com
Max Druchok
SoftServe Inc.,
Lviv, Ukraine
mdruc@softserveinc.com
Hlib Shchur
SoftServe Inc.,
Lviv, Ukraine
hshchu@softserveinc.com
I’m an R&D lead with 10+ years of experience in Game Development, Virtual, Augmented, Mixed Reality, and
Computer Vision research, which includes service R&D projects for customers like Samsung.
I leads research and development efforts in the interactive team.

3. INTERACTIVE
• Interactive expo experiences
• Digital signage
• Mixed reality
• 3D data synthesis
• Serious games

4. SERIOUS GAME #1
TOP SURVEYOR
Problem: Rust looks not too attractive. The
process inspection process is far from fun also. We
had to find a way to make this process enjoyable
to promote AI rust inspection solution at the expo.
Realization: We created a quiz game which let you
compete with AI inspector in corrosion detection.
The game ran on several tablets and mirrored to
TV panels.
Tech used: Unity C#, GCP
Watch Video
Read Press Release

5. SERIOUS GAME #2
CHASM
Problem: People were quite skeptical
about VR technologies. We created a promo gaming-like
experience to showcase
technology.
Realization: The game runs on PC
with HTC Vive headset. Virtual and real
worlds additionally interconnected via
synchronized virtual and real wooden bridge,
user’s legs and wind.
Tech used: Unity C#, Steam VR SDK
Watch Video
Interactive Case Study

6. Our solution – serious game:
• demonstrates a concept of emerging gaming-like remote collaboration experience for researchers,
helping explore and design chemical compounds
• runs on the edge devices with flatscreens and/or Mixed Reality
• supports mixed sessions between local and distant users
https://www.youtube.com/watch?v=u2EIYdxgZZQ&feature=youtu.be

7. ACM CHI, VRST
I’ve contributed to publications at IEEE and ACM. We’ve been accepted to ACM VRST 2020.

8. Collaborative Mixed Reality is a new step over Virtual Reality solutions for the human-machine and human-human interactions.
There are a few solutions for material design in VR as well for remote collaboration in MR
• C4X 4Sight, Novartis and Pfizer VR
• Sansar, Spatial, Facebook Horizon

9. Spatial alignment
• Google ARCore Anchors
• MS Azure Spatial Anchors
• Magic Leap Transmission
Cross-platform
• Magic Leap
• Phone/Tablet
• PC/Mac
Network synchronization
with Photon SDK
• Host
• Interpolation
Avatars
• 1st/3rd person view

10. Left: a screenshot from our app, showing the measured distance in Angstroms between a pair of atoms.
Right: a screenshot, showing the measured angle between a triplet of atoms.

11. Left: a screenshot from our app, showing the gesture input, camrip from MR.
Right: a screenshot, showing the same streaming from the MR headset.

12. We created a single-user prototype for a single Magic Leap platform, experimented with different interaction
scenarios and transformed the app into gaming-like multiplatform multiplayer remote collaborative
experience.
The novelty and uniqueness of our approach is to unite different solutions from chemistry, MR, and spatial
computing in one application.

13. Thanks!
Questions?
sfrish@softserveinc.com
Twitter: @real7a
LinkedIn: in/real7a