DroidKaigi 2018のセッション「AccessibilityService でできてしまうこと」のセッションスライドです。 動画が埋め込まれている都合、当日使用したものと完全に同じではないことをご了承ください

1. AccessibilityService
DroidKaigi 2018 (2/8~2/9)
by Tamaki Hidetsugu (Ralph) @r_ralph_h

2. Tamaki Hidetsugu (Ralph)
• 4
• Twitter: @r_ralph_h
• 2015/2 ~ Holiday
• 2018/4 ~ LINE

3. •
•
•

4. AccessibilityService ?

5. AccessibilityService
•
•
• FB
•
https://developer.android.com/training/accessibility/service.html

6. AccessibilityService
• DroidKaigi 2017
• AccessibilityService
https://speakerdeck.com/litmon/accessibilityservicewoshi-
tuteapurifalseke-neng-xing-woguang-geyou

8. • Google TalkBack

9. AccessibilityService

10. AS
•
•

11. AS
•
• AS
• View
• View

12. AccessibilityService
• AccessibilityService
• AccessibilityService

13. AccessibilityService
•
onAccessibilityEvent()
•
• onAccessibilityEvent()

14. AccessibilityNodeInfo
• View
• ViewGroup child
NodeInfo
• View

15. getRootInActiveWindow()
• AccessibilityNodeInfo
• Activity
NodeInfo
• View

16. View Read
•
• contentDescription
nodeInfo.text
nodeInfo.contentDescription

17. View Write
• EditText
• View
val text = "Hello World"
val args = Bundle().also {
it.putString(
AccessibilityNodeInfo.ACTION_ARGUMENT_SET_TEXT_CHARSEQUENCE,
text)
}
nodeInfo.performAction(AccessibilityNodeInfo.ACTION_SET_TEXT, args)
nodeInfo.performAction(AccessibilityNodeInfo.ACTION_CLICK)

18. AccessibilityService

19. Android
https://www.symantec.com/connect/nl/blogs/android-33

21. 1.

22. • ChatKit
stfalcon-studio/ChatKit

23. View
fun logViewHierarchy(nodeInfo: AccessibilityNodeInfo?,
depth: Int) {
when (nodeInfo?.childCount) {
null -> return
0 -> Log.d(TAG, "${" ".repeat(depth)} " +
"View: ${nodeInfo.className} " +
"(id=${nodeInfo.viewIdResourceName})")
else -> (0 until nodeInfo.childCount)
.map { nodeInfo.getChild(it) }
.forEach { logViewHierarchy(it, depth + 1) }
}
}
getRootInActiveWindow() NodeInfo

24. View
View: android.widget.TextView (id=null)
View: android.widget.TextView (id=ms.ralph.dk2018_sample1:id/messageText)
View: android.widget.TextView (id=ms.ralph.dk2018_sample1:id/messageText)
View: android.widget.TextView (id=ms.ralph.dk2018_sample1:id/messageTime)
View: android.widget.TextView (id=ms.ralph.dk2018_sample1:id/messageText)
View: android.widget.TextView (id=ms.ralph.dk2018_sample1:id/messageTime)
View: android.widget.TextView (id=ms.ralph.dk2018_sample1:id/messageTime)
View: android.widget.TextView (id=ms.ralph.dk2018_sample1:id/messageText)
View: android.widget.TextView (id=ms.ralph.dk2018_sample1:id/messageText)
View: android.widget.TextView (id=ms.ralph.dk2018_sample1:id/messageTime)
View: android.widget.EditText (id=ms.ralph.dk2018_sample1:id/messageInput)
View: android.widget.ImageButton (id=ms.ralph.dk2018_sample1:id/
messageSendButton)
id AccessibilityNodeInfo

25. rootInActiveWindow.findAccessibilityNodeInfosByViewId(
"ms.ralph.android.dk2018_sample1:id/messageText") // <=id
.forEach { Log.d(TAG, it.text.toString()) }

26. val editNode = rootInActiveWindow
.findAccessibilityNodeInfosByViewId(
"ms.ralph.dk2018_sample1:id/messageInput")[0]
pasteText(editNode, System.currentTimeMillis().toString())
pasteText() EditText

28. val time = System.currentTimeMillis()
pasteText(editNode, time.toString())
if (time % 10 == 0L) {
val btnNode = rootInActiveWindow
.findAccessibilityNodeInfosByViewId(
"ms.ralph.dk2018_sample1:id/messageSendButton")[0]
tapButton(btnNode)
}
UNIX 1 0
tapButton() View

30. 2. Runtime Permission

31. Runtime Permission?
Android 6.0

33. Runtime Permission

34. ( )

36. •
•
•

37. • PlayStore
2017/11
http://www.androidpolice.com/2017/11/12/google-will-remove-play-store-apps-use-
accessibility-services-anything-except-helping-disabled-users/

38. •
•
•
•
•

39. Thank you !