分享這幾個月用Unity3D開發ARKit相關應用的心得

1. 開發ARKit的⼼心路路歷程
Prada, YY - Mobile Developers in PicCollage

3. DEMO

4. Unity3D?!
C#?!

5. No Object-C?!
No Swift?!

6. Let me tell you a
story

7. Original Team
• Unity3D Developer Interns x 2
• UI/UX/3D Designer x 1
• Android Developer x 1

8. Unity3D +
ARKit Plugin

9. Start explore ARKit
during hackney

10. 悲劇 1
iOS 11 Beta 5 Change ARKit API !!
iPhone
Beta 5
Xcode
Beta 5
ARKit
Plugin
Beta 5

11. 1st Design

12. We need to support
• Share to Instagram
• Share to Others
• Save Photo/Video in Camera Roll
• Record video

15. 悲劇 2
No free lunch in Asset Store
• Wait, We are the mobile developers

16. StorageKit
AlbumUtils.cs AlbumUtils.mm
$10 USD ?!

17. ShareKit
ShareKit.cs ShareKit.mm
$5 USD ?!
Photos.framework

20. iVidCap Only Support
OpenGLES 2/3
悲劇 3

21. ARKit like to live with
Metal API!

22. Force ARKit work with
OpenGLES 2
https://bitbucket.org/Unity-Technologies/unity-arkit-plugin/pull-requests/6/support-opengl-es-2-as-the-rendering-api/commits

23. 悲劇 4
Pool performance when ARKit run on OpenGLES2/3

24. iVidCapPro interface
http://eccentric-orbits.com/eoe/docs/iVidCapPro_Doc_1_7/classi_vid_cap_pro.html

25. Structure for video recording
RenderTextue
MTLTexture
Unity3D
Native Code
https://docs.unity3d.com/ScriptReference/Texture.GetNativeTexturePtr.html
GetNativeTexturePtr()::IntPtr
CameraCamera Camera…
AVFoundation

26. AVFoundation
• AVAssetWriter
• AVAssetWriterInput
• AVAssetExportSession
• AVMutableComposition

27. MetalKit

28. Dev ARKit on Unity3D
• Pros
• Cross-platform : can support ARCore for Android later
• Better workflow with Designer
• Rich 3D Rendering resource, lighting, shader, particle system
• Cons
• Bad UI performance
• Block by Unity’s Plugin : write a lot of bridge code
• 💸💸💸💸💸💸💸💸