Snapshot Regression Testースナップショットを用いたリグレッション自動テスト
•
1 gostou•1,900 visualizações
データのスナップショットを使って自動化の効率を改善した話
Recomendados
Recomendados
Mais conteúdo relacionado
Semelhante a Snapshot Regression Testースナップショットを用いたリグレッション自動テスト
Semelhante a Snapshot Regression Testースナップショットを用いたリグレッション自動テスト (20)
Mais de Rakuten Group, Inc.
Mais de Rakuten Group, Inc. (20)
Último
Último (20)
Snapshot Regression Testースナップショットを用いたリグレッション自動テスト
- 1. Snapshot Regression Test ースナップショットを用いたリグレッション自動テスト 2020/6/30 Satoru Awasawa Travel Agile Dept. QA Section Rakuten, Inc.
- 2. 2 Agenda Introduction 自己紹介 Rakuten Travel 使ってみてください！ テスト自動化 自動テストの問題って？ じゃーこうすればどうかな？ アーキテクチャー紹介 デモ
- 3. 3 Satoru Awasawa Java Developer + System Architect 7 years in JAPAN AIRLINE system company 5 years in Rakuten Travel ‘Backend API’ Tech Manager 2 years in Rakuten Travel ‘Backend API’ QA Senior Manager 1 year before coming to QA! As of now managing both manual testing and automation testing My hobby Splatoon2(Nintendo-switch) Golf (Not virtual but real!)
- 4. 4 What’s ‘Rakuten Travel’? https://travel.rakuten.co.jp/ (2020/3/22)
- 5. 5 What’s ‘Rakuten Travel’? Domesti c Hotels Overseas hotels JAL DP ANA DP Overseas DP AIR Bus Rent-a- car https://travel.rakuten.com/ (2020/6/18) https://travel.rakuten.co.jp/ (SP) (2020/6/18)
- 6. 6 What’s ‘Rakuten Travel’? https://www.mlit.go.jp/report/press/content/001339698.pdf (国土交通省HPより) (2020/6/18) ©️いらすとや
- 7. 7 What’s the problem of automation test? SCENARIO EXPECTED VALUE TEST DATA
- 8. 8 ©️いらすとや
- 9. 9 Effort Comparison for Test Execution (1000 Test Cases) 0 83 833 1666 500 525 750 1000 0 200 400 600 800 1000 1200 1400 1600 1800 Initial 1time 10times 20times Man*Day（人日） Manual Test Automation Test
- 10. 10 with Getting the snapshot New automation test framework “SRT” https://publicdomainq.net/camera-taking-picture-0019733/
- 11. 11 New Automation Testing ‘SRT’ Manual Tester Data Req• Res• API Req• Res• APIHTTP ©️いらすとや
- 12. 12 New Automation Testing ‘SRT’ Manual Tester Data Req• Res• API Req• Res• APIHTTP Data Req• Res• Req• Res• HTTP Snapshot ©️いらすとや
- 13. 13 New Automation Testing ‘SRT’ Manual Tester Data Req• Res• API • Req • Res APIHTTP Data Req• Res• Req• Res• HTTP Snapshot Get the RQ+RS set snapshot with traceID and stacked it as regression test cases At the same time, Get the Data set snapshot. ©️いらすとや
- 14. 14 New Automation Testing ‘SRT’ Developer Data Req• Res• API Req• Res• APIHTTP Data Req• Res• Req• Res• HTTP Snapshot ©️いらすとや
- 15. 15 New Automation Testing ‘SRT’ Developer Data Req• Res• API • Req • Res APIHTTP Data Req• Res• Req• Res• HTTP Snapshot©️いらすとや
- 16. 16 New Automation Testing ‘SRT’ Developer Data Req• Res• API Req• Res• APIHTTP Data Req• Res• Req• Res• HTTP Snapshot©️いらすとや
- 17. 17 SRT Architecture (TestCase Creation) Manual Tester Capture Start Take Data Snapshot Mongo Oracle Mongo Oracle Log Analyzer Preparation Execution <API RQ/RS Data> <Test Id> <Transaction Id> Test DB <Test Specification> TestID RQ+RS DataSet App Client STG Proxy ©️いらすとや
- 18. 18 SRT Architecture (Test Execution) Developer Restore Data Snapshot Mongo Oracle Commit Test DB <Test Specification> TestID RQ+RS DataSet QA Test Executer Build/Deploy CICD©️いらすとや
- 19. 19 Demo Recordingthe scenario which is tested by manual tester Execution with updated data Execution with wrong code
- 20. 20 ©️いらすとや
- 21. 21 Effort Comparison for Test Execution (1000 Test Cases) 0 83 833 1666 500 525 750 1000 83 84 93 103 0 200 400 600 800 1000 1200 1400 1600 1800 Initial 1time 10times 20times Man*Day（人日） Manual Test Automation Test New AT 'SRT'