iRail at hack democracy

•

0 likes•279 views

Pieter Colpaert

Technology

5 minutes
● Scraping
● The law
● Project problems

Really no other option?
DON'T wait
● For big forms to be filled in
● For officials to respond

DON'T talk too much about your ideas

DO

Different explanations for scraping
● Legal: «show data, differently» (~Browser)
● +/-: «already public data»
● Illegal: «steal data»

Public transport: iRail
● Second database law
● Result of activity = no copyright

● Others don't agree?
● iRail vzw/asbl/npo supports you!

Web2.0: If people like it

It's okay!

Just be awesome

So much choice!
● Java servlets
● PHP
● Perl
● Python
● ...

?
● Limit dirtiness?
● How modular?
● Reusability?

Help each other!
● API
● one time job
● Open source
– Everyone helps fixing
● Patch «the» system!

Conclusion
● SCRAPE
● When no other possibility
● WORK
● Together!
● QUICK & DIRTY
● But clean it up

Q&A

@pietercolpaert
Project.iRail.be

Github.com/iRail

What's hot

The One WayDaniel Greenfeld

Besut Kode Challenge 1John Vandenberg

VirtualJUG24 - Testing with Spock: The logical choiceIván López Martín

Besut Kode - Workshop 1John Vandenberg

The what, how and why of scaling git repositoriesJohan Abildskov

Nordic Testing Days - Tallinn 2017 - Test your Java applications with SpockIván López Martín

Code:Nation Tech StackElton Minetto

Towards a Commons RDF Java librarySergio Fernández

Operational MongoDBMitch Pirtle

First Pull Request - Sergio Ocon - ManageIQ Design Summit 2016ManageIQ

London Java Community 2016 - Testing with Spock: The logical choiceIván López Martín

XOHW19 @ NECSTLabNECST Lab @ Politecnico di Milano

HandsOn: git (or version control in general...)Martin Scharm

Ready, set, go! An introduction to the Go programming languageRTigger

MongoDB at LAHacks :)Randall Hunt

ADDO 2019: Looking back at over 10 years of DevopsKris Buytaert

Pravin s glibc-unicode_and_cldrPravin Satpute

What's hot (17)

The One Way

Besut Kode Challenge 1

VirtualJUG24 - Testing with Spock: The logical choice

Besut Kode - Workshop 1

The what, how and why of scaling git repositories

Nordic Testing Days - Tallinn 2017 - Test your Java applications with Spock

Code:Nation Tech Stack

Towards a Commons RDF Java library

Operational MongoDB

First Pull Request - Sergio Ocon - ManageIQ Design Summit 2016

London Java Community 2016 - Testing with Spock: The logical choice

XOHW19 @ NECSTLab

HandsOn: git (or version control in general...)

Ready, set, go! An introduction to the Go programming language

MongoDB at LAHacks :)

ADDO 2019: Looking back at over 10 years of Devops

Pravin s glibc-unicode_and_cldr

Viewers also liked

Happy exit to 2011GreenfieldProject

Umysl sprzedawcyGucio Silva

Akupresura w-praktyceGucio Silva

Кригер Амалия 2ВYanina

Родительский лекторийYanina

Conte abans d'anar a dormir 1silviamecho

Open and close formsPatricia Gutiérrez Marqués

Models by Percent DiscountTrueCar

NBS corporate brochureNorthampton Business School

7TH ST A102 APR.29.16 ZAlfonso Duran, Assoc. AIA

Sertifikat - Recruitment & SelectionRobi Pandunusa

Quantum vacation broucherQuantum vacations

MGT 255-2 Group 1 Amazon's CSR PaperAmanda Page

Viewers also liked (13)

Happy exit to 2011

Umysl sprzedawcy

Akupresura w-praktyce

Кригер Амалия 2В

Родительский лекторий

Conte abans d'anar a dormir 1

Open and close forms

Models by Percent Discount

NBS corporate brochure

7TH ST A102 APR.29.16 Z

Sertifikat - Recruitment & Selection

Quantum vacation broucher

MGT 255-2 Group 1 Amazon's CSR Paper

Similar to iRail at hack democracy

Python in IndustryDharmit Shah

PloneideFranco Pellegrini

Introduce PythonM Asep Indrayana

Apps 4-antwerp-dec-2012-j-carter-parkshark-and-parkshark-api-antwerpJonathan Carter

Python For All | Software Professionals, QA & DevOps professionalsNilesh Sutar

Python for All Pragya Goyal

Introduction to Idem for Microsoft AzureNicholas Hughes

برنامه نویسی بات تلگرام در پایتونShiraz LUG

Build, deploy and scale: Django, GraphQL and SPA (DjangoCon EU 2021)Dhilipsiva DS

Zope is dead - Long live ZopeLennart Regebro

Teaching Open Source In The UniversityDominique Cimafranca

Advantages of Python Learning | Why PythonEvoletTechnologiesCo

Comingle Arse 2014Andrew Quitmeyer

Techhub Riga - tm 27.07Toms Bauģis

Mixing Plone and Django for explosive resultsSimone Deponti

Open source, What | Why | How Nikhil Agrawal

Os hardware meets os softwarePaul Tanner

Open Source Secret Sauce - Lugor Sep 2011Ted Husted

OSDC 2016 | Another 7 tools for your #devops stack by Kris BuytaertNETWAYS

Introduction to Open Data and Data ScienceSuraj Kumar Jana

Similar to iRail at hack democracy (20)

Python in Industry

Ploneide

Introduce Python

Apps 4-antwerp-dec-2012-j-carter-parkshark-and-parkshark-api-antwerp

Python For All | Software Professionals, QA & DevOps professionals

Python for All

Introduction to Idem for Microsoft Azure

برنامه نویسی بات تلگرام در پایتون

Build, deploy and scale: Django, GraphQL and SPA (DjangoCon EU 2021)

Zope is dead - Long live Zope

Teaching Open Source In The University

Advantages of Python Learning | Why Python

Comingle Arse 2014

Techhub Riga - tm 27.07

Mixing Plone and Django for explosive results

Open source, What | Why | How

Os hardware meets os software

Open Source Secret Sauce - Lugor Sep 2011

OSDC 2016 | Another 7 tools for your #devops stack by Kris Buytaert

Introduction to Open Data and Data Science

Recently uploaded

TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung

Manulife - Insurer Transformation Award 2024The Digital Insurer

Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...apidays

DBX First Quarter 2024 Investor PresentationDropbox

Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1

How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes

MS Copilot expands with MS Graph connectorsNanddeep Nachan

MINDCTI Revenue Release Quarter One 2024MIND CTI

Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbuapidays

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays

A Year of the Servo Reboot: Where Are We Now?Igalia

AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin

Automating Google Workspace (GWS) & more with Apps Scriptwesley chun

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWERMadyBayot

Recently uploaded (20)

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Manulife - Insurer Transformation Award 2024

Exploring the Future Potential of AI-Enabled Smartphone Processors

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

DBX First Quarter 2024 Investor Presentation

Boost Fertility New Invention Ups Success Rates.pdf

How to Troubleshoot Apps for the Modern Connected Worker

MS Copilot expands with MS Graph connectors

MINDCTI Revenue Release Quarter One 2024

Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

A Year of the Servo Reboot: Where Are We Now?

AWS Community Day CPH - Three problems of Terraform

Automating Google Workspace (GWS) & more with Apps Script

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

iRail at hack democracy

1. iRail and open data @pietercolpaert Hack democracy

2. 5 minutes ● Scraping ● The law ● Project problems

3. Why?

4. Really no other option? DON'T wait ● For big forms to be filled in ● For officials to respond DON'T talk too much about your ideas DO

5. A Lot Of Laws

6. Different explanations for scraping ● Legal: «show data, differently» (~Browser) ● +/-: «already public data» ● Illegal: «steal data»

7. Public transport: iRail ● Second database law ● Result of activity = no copyright ● Others don't agree? ● iRail vzw/asbl/npo supports you!

8. But! Who cares about laws?

9. Web2.0: If people like it It's okay! Just be awesome

10. Design problems

11. So much choice! ● Java servlets ● PHP ● Perl ● Python ● ...

12.

13. ? ● Limit dirtiness? ● How modular? ● Reusability?

14. Help each other! ● API ● one time job ● Open source – Everyone helps fixing ● Patch «the» system!

15. Conclusion ● SCRAPE ● When no other possibility ● WORK ● Together! ● QUICK & DIRTY ● But clean it up

16. Q&A @pietercolpaert Project.iRail.be Github.com/iRail

iRail at hack democracy

Recommended

Recommended

More Related Content

What's hot

What's hot (17)

Viewers also liked

Viewers also liked (13)

Similar to iRail at hack democracy

Similar to iRail at hack democracy (20)

More from Pieter Colpaert

More from Pieter Colpaert (19)

Recently uploaded

Recently uploaded (20)

iRail at hack democracy