SlideShare uma empresa Scribd logo
1 de 29
Baixar para ler offline
TOWARDS
VISUAL ANALYTICS
TO IMPROVE
SCIENTIFIC
READING & WRITING
Duygu Simsek
PhD Research Student
Knowledge Media Institute
The Open University, UK
The Open
Science
Laboratory
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
Supervisors: Prof. Simon Buckingham Shum, Dr. Rebecca Ferguson, Dr. Anna De Liddo
Xerox Research Centre Europe: Ágnes Sándor
people.kmi.open.ac.uk/simsek
duygu.simsek@open.ac.uk
simsekduygu_
“Piled Higher and Deeper” by Jorge Cham www.phdcomics.com
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
Imagine if a machine that could detect…
Human analyst
-Highlight key contributions of the project outcomes
http://bit.ly/HumanVsXIP
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
Human analyst
http://bit.ly/HumanVsXIP
XIP
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
Imagine if a machine that could detect…
Reading a Paper Writing a Paper
CRITICAL MIND
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
Engaging with the literature
Being able to
critique and
contrast
Identifying
gaps in
our
knowledge
Identifying
when
significant
claims
made
Reading a Paper Writing a Paper
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
Engaging with the literature
o What’s the research problem about X?
o What are the open questions about X?
o What has been found about X?
o What are the research themes for X?
o Are there any major advances concerning X?
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
Scholarly writing has particular hallmarks!
oMeta-discourse Signals
o The problem, the claim, the
argument, the evidence and the
implications
o Explicitly organises the
discourse, expresses a
viewpoint, engages the readers,
and signals the writer's stance
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
Meta-discourse
oAutomatic processing of scientific documents
oRecognition of the rhetorically significant sentences
o8 categories of Rhetorical Moves
o Background Knowledge
o Summarising
o Tendency
o Novelty
o Significance
o Surprise
o Open Question
o Contrasting Ideas
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
Xerox Incremental Parser (XIP)
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
Xerox Incremental Parser (XIP)
Xerox Incremental Parser (XIP)
BACKGROUND
KNOWLEDGE:
Recent studies indicate …
the previously proposed …
… is universally accepted
http://bit.ly/DCLA13
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
Xerox Incremental Parser (XIP)
BACKGROUND
KNOWLEDGE:
Recent studies indicate …
the previously proposed …
… is universally accepted
SUMMARISING:
The goal of this study ...
Here, we show ...
Our results ... indicate
http://bit.ly/DCLA13
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
Xerox Incremental Parser (XIP)
BACKGROUND
KNOWLEDGE:
Recent studies indicate …
the previously proposed …
… is universally accepted
TENDENCY:
... emerging as a promising
approach
Our understanding ... has
grown exponentially ...
Growing recognition of the
importance ...
SUMMARISING:
The goal of this study ...
Here, we show ...
Our results ... indicate
http://bit.ly/DCLA13
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
Xerox Incremental Parser (XIP)
BACKGROUND
KNOWLEDGE:
Recent studies indicate …
the previously proposed …
… is universally accepted
NOVELTY:
New insights provide direct
evidence…
…suggest a new approach…
Results define a novel role ...
TENDENCY:
... emerging as a promising
approach
Our understanding ... has
grown exponentially ...
Growing recognition of the
importance ...
SUMMARISING:
The goal of this study ...
Here, we show ...
Our results ... indicate
http://bit.ly/DCLA13
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
Xerox Incremental Parser (XIP)
BACKGROUND
KNOWLEDGE:
Recent studies indicate …
the previously proposed …
… is universally accepted
NOVELTY:
New insights provide direct
evidence…
…suggest a new approach…
Results define a novel role ...
TENDENCY:
... emerging as a promising
approach
Our understanding ... has
grown exponentially ...
Growing recognition of the
importance ...
SIGNIFICANCE:
studies ... have provided important
advances
... is crucial for ... understanding
valuable information ... from
SUMMARISING:
The goal of this study ...
Here, we show ...
Our results ... indicate
http://bit.ly/DCLA13
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
Xerox Incremental Parser (XIP)
BACKGROUND
KNOWLEDGE:
Recent studies indicate …
the previously proposed …
… is universally accepted
NOVELTY:
New insights provide direct
evidence…
…suggest a new approach…
Results define a novel role ...
TENDENCY:
... emerging as a promising
approach
Our understanding ... has
grown exponentially ...
Growing recognition of the
importance ...
SIGNIFICANCE:
studies ... have provided important
advances
... is crucial for ... understanding
valuable information ... from
SURPRISE:
We have recently observed ...
surprisingly
We have identified ... unusual
The recent discovery ... suggests
intriguing roles
SUMMARISING:
The goal of this study ...
Here, we show ...
Our results ... indicate
http://bit.ly/DCLA13
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
Xerox Incremental Parser (XIP)
BACKGROUND
KNOWLEDGE:
Recent studies indicate …
the previously proposed …
… is universally accepted
NOVELTY:
New insights provide direct
evidence…
…suggest a new approach…
Results define a novel role ...
OPEN QUESTION:
Little is known …
… role … has been elusive
Current data is insufficient…
TENDENCY:
... emerging as a promising
approach
Our understanding ... has
grown exponentially ...
Growing recognition of the
importance ...
SIGNIFICANCE:
studies ... have provided important
advances
... is crucial for ... understanding
valuable information ... from
SURPRISE:
We have recently observed ...
surprisingly
We have identified ... unusual
The recent discovery ... suggests
intriguing roles
SUMMARISING:
The goal of this study ...
Here, we show ...
Our results ... indicate
http://bit.ly/DCLA13
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
Xerox Incremental Parser (XIP)
BACKGROUND
KNOWLEDGE:
Recent studies indicate …
the previously proposed …
… is universally accepted
NOVELTY:
New insights provide direct
evidence…
…suggest a new approach…
Results define a novel role ...
OPEN QUESTION:
Little is known …
… role … has been elusive
Current data is insufficient…
TENDENCY:
... emerging as a promising
approach
Our understanding ... has
grown exponentially ...
Growing recognition of the
importance ...
CONTRASTING IDEAS:
In contrast with previous
hypotheses ...
... inconsistent with past
findings ...
SIGNIFICANCE:
studies ... have provided important
advances
... is crucial for ... understanding
valuable information ... from
SURPRISE:
We have recently observed ...
surprisingly
We have identified ... unusual
The recent discovery ... suggests
intriguing roles
SUMMARISING:
The goal of this study ...
Here, we show ...
Our results ... indicate
http://bit.ly/DCLA13
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
o Fine for researchers or
machines but it is not
learner/educator friendly
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
XIP Output
Visual Analytics of XIP Output
o Dataset
Proceedings of the Learning Analytics and Knowledge (LAK)
conferences since 2011and a journal special issue, and the
Educational Data Mining (EDM) conferences since 2008 and
journal.
o XIP Analysis
All of the papers (66 LAK and 239 EDM papers 305 in
total) were analysed using XIP, extracting 7847 sentences and
40163 concepts.
o Paper Prototype
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
o Similar patterns in LAK &
EDM
o Summary & Contrast
categories higher &
rising
Visual Analytics of XIP Output
http://bit.ly/DCLA13
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
Visual Analytics of XIP Output
http://bit.ly/DCLA13
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
Visual Analytics of XIP Output
http://bit.ly/DCLA13
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
Learning Analytics Potential?
oA promising language technology
oNow visual analytics built on top of it
oWhat happens when we bring it into the realm
of learning?
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
S288 Practical Science
o ~300 undergraduate students
o 5 strands:
o Physics and Astronomy
o Chemistry and Analysis
o Environmental Sciences
o Earth and Environment
o Biology and Health
o Collaborative scientific writing assignment
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
Learning Analytics Potential?
Learning Analytics Potential?
XIP Highlighted Student Essays
Is the use of XIP’s rhetorical
categories predictive of final
grades?
Student Grades
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
Learning Analytics Potential?
What is the overlap between
XIP’s output and how tutors
judge quality?
Tutor Highlighted Student Essays
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
XIP Highlighted Student Essays
Do learners find it helpful to receive
formative feedback of this sort on their
own writing, or of the literature?
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
Learning Analytics Potential?
C
O
L
L
A
B
O
R
A
T
I
V
E
W
R
I
T
I
N
G
E
D
I
T
O
R
Resources & Contact Details
o Simsek, D., Buckingham Shum, S., Sándor, Á., De Liddo, A. and Ferguson, R.
(2013). XIP Dashboard: Visual Analytics from Automated Rhetorical Parsing of
Scientific Metadiscourse. 1st International Workshop on Discourse-Centric
Learning Analytics. (3rd International Conference on Learning Analytics &
Knowledge, 8 April 2013, Leuven, Belgium). http://bit.ly/DCLA13
o Taibi, D., Sándor, Á., Simsek, D., Buckingham Shum, S., De Liddo, A. and
Ferguson, R. (2013) Visualizing the LAK/EDM Literature Using Combined
Concept and Rhetorical Sentence Extraction, 1st Learning Analytics and
Knowledge Data Challenge at Learning Analytics and Knowledge (LAK ’13),
Leuven, Belgium http://bit.ly/DataChal
o De Liddo, Anna; Sándor, Ágnes and Buckingham Shum, Simon (2012).
Contested Collective Intelligence: rationale, technologies, and a human-machine
annotation study. Computer Supported Cooperative Work (CSCW), 21(4-5) pp.
417–448. http://bit.ly/HumanVsXIP
people.kmi.open.ac.uk/simsek
duygu.simsek@open.ac.uk
simsekduygu_
Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013

Mais conteúdo relacionado

Destaque

Klink-2: integrating multiple web sources to generate semantic topic networks
 Klink-2: integrating multiple web sources to generate semantic topic networks Klink-2: integrating multiple web sources to generate semantic topic networks
Klink-2: integrating multiple web sources to generate semantic topic networksFrancesco Osborne
 
Study and experiments of a framework for disseminating semantic annotations i...
Study and experiments of a framework for disseminating semantic annotations i...Study and experiments of a framework for disseminating semantic annotations i...
Study and experiments of a framework for disseminating semantic annotations i...Giorgio Basile
 
Making Thinking Visible in Complex Times
Making Thinking Visible in Complex TimesMaking Thinking Visible in Complex Times
Making Thinking Visible in Complex TimesSimon Buckingham Shum
 
EKAW 2016 - Ontology Forecasting in Scientific Literature: Semantic Concepts ...
EKAW 2016 - Ontology Forecasting in Scientific Literature: Semantic Concepts ...EKAW 2016 - Ontology Forecasting in Scientific Literature: Semantic Concepts ...
EKAW 2016 - Ontology Forecasting in Scientific Literature: Semantic Concepts ...Francesco Osborne
 
The Election Debate Visualisation Project - KMi Internal Seminar - 19 June 2014
The Election Debate Visualisation Project - KMi Internal Seminar - 19 June 2014The Election Debate Visualisation Project - KMi Internal Seminar - 19 June 2014
The Election Debate Visualisation Project - KMi Internal Seminar - 19 June 2014EDV Project
 

Destaque (6)

Klink-2: integrating multiple web sources to generate semantic topic networks
 Klink-2: integrating multiple web sources to generate semantic topic networks Klink-2: integrating multiple web sources to generate semantic topic networks
Klink-2: integrating multiple web sources to generate semantic topic networks
 
Study and experiments of a framework for disseminating semantic annotations i...
Study and experiments of a framework for disseminating semantic annotations i...Study and experiments of a framework for disseminating semantic annotations i...
Study and experiments of a framework for disseminating semantic annotations i...
 
Making Thinking Visible in Complex Times
Making Thinking Visible in Complex TimesMaking Thinking Visible in Complex Times
Making Thinking Visible in Complex Times
 
EKAW 2016 - Ontology Forecasting in Scientific Literature: Semantic Concepts ...
EKAW 2016 - Ontology Forecasting in Scientific Literature: Semantic Concepts ...EKAW 2016 - Ontology Forecasting in Scientific Literature: Semantic Concepts ...
EKAW 2016 - Ontology Forecasting in Scientific Literature: Semantic Concepts ...
 
The Election Debate Visualisation Project - KMi Internal Seminar - 19 June 2014
The Election Debate Visualisation Project - KMi Internal Seminar - 19 June 2014The Election Debate Visualisation Project - KMi Internal Seminar - 19 June 2014
The Election Debate Visualisation Project - KMi Internal Seminar - 19 June 2014
 
BCII 2016 - Visualizing Complexity
BCII 2016 - Visualizing ComplexityBCII 2016 - Visualizing Complexity
BCII 2016 - Visualizing Complexity
 

Semelhante a Towards Visual Analytics to Improve Scientific Reading & Writing

APL: Academic & Professional Literacies Forum Talk
APL: Academic & Professional Literacies Forum TalkAPL: Academic & Professional Literacies Forum Talk
APL: Academic & Professional Literacies Forum TalkDuygu Bektik
 
SGCI + ESIP = Community Action
SGCI + ESIP = Community ActionSGCI + ESIP = Community Action
SGCI + ESIP = Community ActionErin Robinson
 
Developing and sharing tools for bioelectromagnetic research
Developing and sharing tools for bioelectromagnetic researchDeveloping and sharing tools for bioelectromagnetic research
Developing and sharing tools for bioelectromagnetic researchRobert Oostenveld
 
ICIC 2016: Examining Funding Data to Predict the Future of Research
ICIC 2016: Examining Funding Data to Predict the Future of ResearchICIC 2016: Examining Funding Data to Predict the Future of Research
ICIC 2016: Examining Funding Data to Predict the Future of ResearchDr. Haxel Consult
 
Open Science, Open Access
Open Science, Open AccessOpen Science, Open Access
Open Science, Open AccessPaola Gargiulo
 
What is Inquiry? pt 2
What is Inquiry? pt 2What is Inquiry? pt 2
What is Inquiry? pt 2E Brunsell
 
Dsd int 2014 - data science symposium - 4th paradigm a research perspective, ...
Dsd int 2014 - data science symposium - 4th paradigm a research perspective, ...Dsd int 2014 - data science symposium - 4th paradigm a research perspective, ...
Dsd int 2014 - data science symposium - 4th paradigm a research perspective, ...Deltares
 
Academic Networking with Digital Tools
Academic Networking with Digital ToolsAcademic Networking with Digital Tools
Academic Networking with Digital ToolsJo Havemann
 
Reproducible, Open Data Science in the Life Sciences
Reproducible, Open  Data Science in the  Life SciencesReproducible, Open  Data Science in the  Life Sciences
Reproducible, Open Data Science in the Life SciencesEamonn Maguire
 
Machine Support for Interacting with Scientific Publications Improving Inform...
Machine Support for Interacting with Scientific Publications Improving Inform...Machine Support for Interacting with Scientific Publications Improving Inform...
Machine Support for Interacting with Scientific Publications Improving Inform...Christoph Lange
 
Open Data and the Social Sciences - OpenCon Community Webcast
Open Data and the Social Sciences - OpenCon Community WebcastOpen Data and the Social Sciences - OpenCon Community Webcast
Open Data and the Social Sciences - OpenCon Community WebcastRight to Research
 
Open Science in the Institutional Setting (Presentation by Eva Méndez at DI4...
Open Science  in the Institutional Setting (Presentation by Eva Méndez at DI4...Open Science  in the Institutional Setting (Presentation by Eva Méndez at DI4...
Open Science in the Institutional Setting (Presentation by Eva Méndez at DI4...OpenAIRE
 
CNI fall 2009 enhanced publications john_doove-SURFfoundation
CNI fall 2009 enhanced publications john_doove-SURFfoundationCNI fall 2009 enhanced publications john_doove-SURFfoundation
CNI fall 2009 enhanced publications john_doove-SURFfoundationJohn Doove
 
Research & proposal
Research & proposalResearch & proposal
Research & proposalPadma Shahi
 
Science Communication: New ways to reach citizens and policy-makers in the po...
Science Communication: New ways to reach citizens and policy-makers in the po...Science Communication: New ways to reach citizens and policy-makers in the po...
Science Communication: New ways to reach citizens and policy-makers in the po...Jorge Aguado Sánchez
 
Research Data in an Open Science World - Prof. Dr. Eva Mendez, uc3m
Research Data in an Open Science World - Prof. Dr. Eva Mendez, uc3mResearch Data in an Open Science World - Prof. Dr. Eva Mendez, uc3m
Research Data in an Open Science World - Prof. Dr. Eva Mendez, uc3mLEARN Project
 
The Student's and Researcher's Guide to Discovery: Exploring Scientific Field...
The Student's and Researcher's Guide to Discovery: Exploring Scientific Field...The Student's and Researcher's Guide to Discovery: Exploring Scientific Field...
The Student's and Researcher's Guide to Discovery: Exploring Scientific Field...Open Knowledge Maps
 

Semelhante a Towards Visual Analytics to Improve Scientific Reading & Writing (20)

APL: Academic & Professional Literacies Forum Talk
APL: Academic & Professional Literacies Forum TalkAPL: Academic & Professional Literacies Forum Talk
APL: Academic & Professional Literacies Forum Talk
 
SGCI + ESIP = Community Action
SGCI + ESIP = Community ActionSGCI + ESIP = Community Action
SGCI + ESIP = Community Action
 
20130918 ectel cyprus_jose
20130918 ectel cyprus_jose20130918 ectel cyprus_jose
20130918 ectel cyprus_jose
 
Dokbat 2016 plenary
Dokbat 2016 plenaryDokbat 2016 plenary
Dokbat 2016 plenary
 
Developing and sharing tools for bioelectromagnetic research
Developing and sharing tools for bioelectromagnetic researchDeveloping and sharing tools for bioelectromagnetic research
Developing and sharing tools for bioelectromagnetic research
 
ICIC 2016: Examining Funding Data to Predict the Future of Research
ICIC 2016: Examining Funding Data to Predict the Future of ResearchICIC 2016: Examining Funding Data to Predict the Future of Research
ICIC 2016: Examining Funding Data to Predict the Future of Research
 
Open Science, Open Access
Open Science, Open AccessOpen Science, Open Access
Open Science, Open Access
 
What is Inquiry? pt 2
What is Inquiry? pt 2What is Inquiry? pt 2
What is Inquiry? pt 2
 
Dsd int 2014 - data science symposium - 4th paradigm a research perspective, ...
Dsd int 2014 - data science symposium - 4th paradigm a research perspective, ...Dsd int 2014 - data science symposium - 4th paradigm a research perspective, ...
Dsd int 2014 - data science symposium - 4th paradigm a research perspective, ...
 
Academic Networking with Digital Tools
Academic Networking with Digital ToolsAcademic Networking with Digital Tools
Academic Networking with Digital Tools
 
Reproducible, Open Data Science in the Life Sciences
Reproducible, Open  Data Science in the  Life SciencesReproducible, Open  Data Science in the  Life Sciences
Reproducible, Open Data Science in the Life Sciences
 
Machine Support for Interacting with Scientific Publications Improving Inform...
Machine Support for Interacting with Scientific Publications Improving Inform...Machine Support for Interacting with Scientific Publications Improving Inform...
Machine Support for Interacting with Scientific Publications Improving Inform...
 
Open Data and the Social Sciences - OpenCon Community Webcast
Open Data and the Social Sciences - OpenCon Community WebcastOpen Data and the Social Sciences - OpenCon Community Webcast
Open Data and the Social Sciences - OpenCon Community Webcast
 
Echoes from yonder
Echoes from yonderEchoes from yonder
Echoes from yonder
 
Open Science in the Institutional Setting (Presentation by Eva Méndez at DI4...
Open Science  in the Institutional Setting (Presentation by Eva Méndez at DI4...Open Science  in the Institutional Setting (Presentation by Eva Méndez at DI4...
Open Science in the Institutional Setting (Presentation by Eva Méndez at DI4...
 
CNI fall 2009 enhanced publications john_doove-SURFfoundation
CNI fall 2009 enhanced publications john_doove-SURFfoundationCNI fall 2009 enhanced publications john_doove-SURFfoundation
CNI fall 2009 enhanced publications john_doove-SURFfoundation
 
Research & proposal
Research & proposalResearch & proposal
Research & proposal
 
Science Communication: New ways to reach citizens and policy-makers in the po...
Science Communication: New ways to reach citizens and policy-makers in the po...Science Communication: New ways to reach citizens and policy-makers in the po...
Science Communication: New ways to reach citizens and policy-makers in the po...
 
Research Data in an Open Science World - Prof. Dr. Eva Mendez, uc3m
Research Data in an Open Science World - Prof. Dr. Eva Mendez, uc3mResearch Data in an Open Science World - Prof. Dr. Eva Mendez, uc3m
Research Data in an Open Science World - Prof. Dr. Eva Mendez, uc3m
 
The Student's and Researcher's Guide to Discovery: Exploring Scientific Field...
The Student's and Researcher's Guide to Discovery: Exploring Scientific Field...The Student's and Researcher's Guide to Discovery: Exploring Scientific Field...
The Student's and Researcher's Guide to Discovery: Exploring Scientific Field...
 

Último

Clinical Pharmacy Introduction to Clinical Pharmacy, Concept of clinical pptx
Clinical Pharmacy  Introduction to Clinical Pharmacy, Concept of clinical pptxClinical Pharmacy  Introduction to Clinical Pharmacy, Concept of clinical pptx
Clinical Pharmacy Introduction to Clinical Pharmacy, Concept of clinical pptxraviapr7
 
What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?TechSoup
 
Philosophy of Education and Educational Philosophy
Philosophy of Education  and Educational PhilosophyPhilosophy of Education  and Educational Philosophy
Philosophy of Education and Educational PhilosophyShuvankar Madhu
 
5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...CaraSkikne1
 
CapTechU Doctoral Presentation -March 2024 slides.pptx
CapTechU Doctoral Presentation -March 2024 slides.pptxCapTechU Doctoral Presentation -March 2024 slides.pptx
CapTechU Doctoral Presentation -March 2024 slides.pptxCapitolTechU
 
M-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptxM-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptxDr. Santhosh Kumar. N
 
Benefits & Challenges of Inclusive Education
Benefits & Challenges of Inclusive EducationBenefits & Challenges of Inclusive Education
Benefits & Challenges of Inclusive EducationMJDuyan
 
Human-AI Co-Creation of Worked Examples for Programming Classes
Human-AI Co-Creation of Worked Examples for Programming ClassesHuman-AI Co-Creation of Worked Examples for Programming Classes
Human-AI Co-Creation of Worked Examples for Programming ClassesMohammad Hassany
 
3.21.24 The Origins of Black Power.pptx
3.21.24  The Origins of Black Power.pptx3.21.24  The Origins of Black Power.pptx
3.21.24 The Origins of Black Power.pptxmary850239
 
Easter in the USA presentation by Chloe.
Easter in the USA presentation by Chloe.Easter in the USA presentation by Chloe.
Easter in the USA presentation by Chloe.EnglishCEIPdeSigeiro
 
Quality Assurance_GOOD LABORATORY PRACTICE
Quality Assurance_GOOD LABORATORY PRACTICEQuality Assurance_GOOD LABORATORY PRACTICE
Quality Assurance_GOOD LABORATORY PRACTICESayali Powar
 
Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...raviapr7
 
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdfMaximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdfTechSoup
 
Presentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a ParagraphPresentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a ParagraphNetziValdelomar1
 
How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17Celine George
 
How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17Celine George
 
General views of Histopathology and step
General views of Histopathology and stepGeneral views of Histopathology and step
General views of Histopathology and stepobaje godwin sunday
 
CAULIFLOWER BREEDING 1 Parmar pptx
CAULIFLOWER BREEDING 1 Parmar pptxCAULIFLOWER BREEDING 1 Parmar pptx
CAULIFLOWER BREEDING 1 Parmar pptxSaurabhParmar42
 
UKCGE Parental Leave Discussion March 2024
UKCGE Parental Leave Discussion March 2024UKCGE Parental Leave Discussion March 2024
UKCGE Parental Leave Discussion March 2024UKCGE
 

Último (20)

Clinical Pharmacy Introduction to Clinical Pharmacy, Concept of clinical pptx
Clinical Pharmacy  Introduction to Clinical Pharmacy, Concept of clinical pptxClinical Pharmacy  Introduction to Clinical Pharmacy, Concept of clinical pptx
Clinical Pharmacy Introduction to Clinical Pharmacy, Concept of clinical pptx
 
What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?
 
Philosophy of Education and Educational Philosophy
Philosophy of Education  and Educational PhilosophyPhilosophy of Education  and Educational Philosophy
Philosophy of Education and Educational Philosophy
 
5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...
 
CapTechU Doctoral Presentation -March 2024 slides.pptx
CapTechU Doctoral Presentation -March 2024 slides.pptxCapTechU Doctoral Presentation -March 2024 slides.pptx
CapTechU Doctoral Presentation -March 2024 slides.pptx
 
M-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptxM-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptx
 
Benefits & Challenges of Inclusive Education
Benefits & Challenges of Inclusive EducationBenefits & Challenges of Inclusive Education
Benefits & Challenges of Inclusive Education
 
Human-AI Co-Creation of Worked Examples for Programming Classes
Human-AI Co-Creation of Worked Examples for Programming ClassesHuman-AI Co-Creation of Worked Examples for Programming Classes
Human-AI Co-Creation of Worked Examples for Programming Classes
 
Prelims of Kant get Marx 2.0: a general politics quiz
Prelims of Kant get Marx 2.0: a general politics quizPrelims of Kant get Marx 2.0: a general politics quiz
Prelims of Kant get Marx 2.0: a general politics quiz
 
3.21.24 The Origins of Black Power.pptx
3.21.24  The Origins of Black Power.pptx3.21.24  The Origins of Black Power.pptx
3.21.24 The Origins of Black Power.pptx
 
Easter in the USA presentation by Chloe.
Easter in the USA presentation by Chloe.Easter in the USA presentation by Chloe.
Easter in the USA presentation by Chloe.
 
Quality Assurance_GOOD LABORATORY PRACTICE
Quality Assurance_GOOD LABORATORY PRACTICEQuality Assurance_GOOD LABORATORY PRACTICE
Quality Assurance_GOOD LABORATORY PRACTICE
 
Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...
 
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdfMaximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
 
Presentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a ParagraphPresentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a Paragraph
 
How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17
 
How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17
 
General views of Histopathology and step
General views of Histopathology and stepGeneral views of Histopathology and step
General views of Histopathology and step
 
CAULIFLOWER BREEDING 1 Parmar pptx
CAULIFLOWER BREEDING 1 Parmar pptxCAULIFLOWER BREEDING 1 Parmar pptx
CAULIFLOWER BREEDING 1 Parmar pptx
 
UKCGE Parental Leave Discussion March 2024
UKCGE Parental Leave Discussion March 2024UKCGE Parental Leave Discussion March 2024
UKCGE Parental Leave Discussion March 2024
 

Towards Visual Analytics to Improve Scientific Reading & Writing

  • 1. TOWARDS VISUAL ANALYTICS TO IMPROVE SCIENTIFIC READING & WRITING Duygu Simsek PhD Research Student Knowledge Media Institute The Open University, UK The Open Science Laboratory Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013 Supervisors: Prof. Simon Buckingham Shum, Dr. Rebecca Ferguson, Dr. Anna De Liddo Xerox Research Centre Europe: Ágnes Sándor people.kmi.open.ac.uk/simsek duygu.simsek@open.ac.uk simsekduygu_
  • 2. “Piled Higher and Deeper” by Jorge Cham www.phdcomics.com Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
  • 3. Imagine if a machine that could detect… Human analyst -Highlight key contributions of the project outcomes http://bit.ly/HumanVsXIP Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
  • 4. Human analyst http://bit.ly/HumanVsXIP XIP Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013 Imagine if a machine that could detect…
  • 5. Reading a Paper Writing a Paper CRITICAL MIND Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013 Engaging with the literature
  • 6. Being able to critique and contrast Identifying gaps in our knowledge Identifying when significant claims made Reading a Paper Writing a Paper Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013 Engaging with the literature
  • 7. o What’s the research problem about X? o What are the open questions about X? o What has been found about X? o What are the research themes for X? o Are there any major advances concerning X? Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013 Scholarly writing has particular hallmarks!
  • 8. oMeta-discourse Signals o The problem, the claim, the argument, the evidence and the implications o Explicitly organises the discourse, expresses a viewpoint, engages the readers, and signals the writer's stance Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013 Meta-discourse
  • 9. oAutomatic processing of scientific documents oRecognition of the rhetorically significant sentences o8 categories of Rhetorical Moves o Background Knowledge o Summarising o Tendency o Novelty o Significance o Surprise o Open Question o Contrasting Ideas Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013 Xerox Incremental Parser (XIP)
  • 10. Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013 Xerox Incremental Parser (XIP)
  • 11. Xerox Incremental Parser (XIP) BACKGROUND KNOWLEDGE: Recent studies indicate … the previously proposed … … is universally accepted http://bit.ly/DCLA13 Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
  • 12. Xerox Incremental Parser (XIP) BACKGROUND KNOWLEDGE: Recent studies indicate … the previously proposed … … is universally accepted SUMMARISING: The goal of this study ... Here, we show ... Our results ... indicate http://bit.ly/DCLA13 Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
  • 13. Xerox Incremental Parser (XIP) BACKGROUND KNOWLEDGE: Recent studies indicate … the previously proposed … … is universally accepted TENDENCY: ... emerging as a promising approach Our understanding ... has grown exponentially ... Growing recognition of the importance ... SUMMARISING: The goal of this study ... Here, we show ... Our results ... indicate http://bit.ly/DCLA13 Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
  • 14. Xerox Incremental Parser (XIP) BACKGROUND KNOWLEDGE: Recent studies indicate … the previously proposed … … is universally accepted NOVELTY: New insights provide direct evidence… …suggest a new approach… Results define a novel role ... TENDENCY: ... emerging as a promising approach Our understanding ... has grown exponentially ... Growing recognition of the importance ... SUMMARISING: The goal of this study ... Here, we show ... Our results ... indicate http://bit.ly/DCLA13 Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
  • 15. Xerox Incremental Parser (XIP) BACKGROUND KNOWLEDGE: Recent studies indicate … the previously proposed … … is universally accepted NOVELTY: New insights provide direct evidence… …suggest a new approach… Results define a novel role ... TENDENCY: ... emerging as a promising approach Our understanding ... has grown exponentially ... Growing recognition of the importance ... SIGNIFICANCE: studies ... have provided important advances ... is crucial for ... understanding valuable information ... from SUMMARISING: The goal of this study ... Here, we show ... Our results ... indicate http://bit.ly/DCLA13 Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
  • 16. Xerox Incremental Parser (XIP) BACKGROUND KNOWLEDGE: Recent studies indicate … the previously proposed … … is universally accepted NOVELTY: New insights provide direct evidence… …suggest a new approach… Results define a novel role ... TENDENCY: ... emerging as a promising approach Our understanding ... has grown exponentially ... Growing recognition of the importance ... SIGNIFICANCE: studies ... have provided important advances ... is crucial for ... understanding valuable information ... from SURPRISE: We have recently observed ... surprisingly We have identified ... unusual The recent discovery ... suggests intriguing roles SUMMARISING: The goal of this study ... Here, we show ... Our results ... indicate http://bit.ly/DCLA13 Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
  • 17. Xerox Incremental Parser (XIP) BACKGROUND KNOWLEDGE: Recent studies indicate … the previously proposed … … is universally accepted NOVELTY: New insights provide direct evidence… …suggest a new approach… Results define a novel role ... OPEN QUESTION: Little is known … … role … has been elusive Current data is insufficient… TENDENCY: ... emerging as a promising approach Our understanding ... has grown exponentially ... Growing recognition of the importance ... SIGNIFICANCE: studies ... have provided important advances ... is crucial for ... understanding valuable information ... from SURPRISE: We have recently observed ... surprisingly We have identified ... unusual The recent discovery ... suggests intriguing roles SUMMARISING: The goal of this study ... Here, we show ... Our results ... indicate http://bit.ly/DCLA13 Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
  • 18. Xerox Incremental Parser (XIP) BACKGROUND KNOWLEDGE: Recent studies indicate … the previously proposed … … is universally accepted NOVELTY: New insights provide direct evidence… …suggest a new approach… Results define a novel role ... OPEN QUESTION: Little is known … … role … has been elusive Current data is insufficient… TENDENCY: ... emerging as a promising approach Our understanding ... has grown exponentially ... Growing recognition of the importance ... CONTRASTING IDEAS: In contrast with previous hypotheses ... ... inconsistent with past findings ... SIGNIFICANCE: studies ... have provided important advances ... is crucial for ... understanding valuable information ... from SURPRISE: We have recently observed ... surprisingly We have identified ... unusual The recent discovery ... suggests intriguing roles SUMMARISING: The goal of this study ... Here, we show ... Our results ... indicate http://bit.ly/DCLA13 Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
  • 19. o Fine for researchers or machines but it is not learner/educator friendly Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013 XIP Output
  • 20. Visual Analytics of XIP Output o Dataset Proceedings of the Learning Analytics and Knowledge (LAK) conferences since 2011and a journal special issue, and the Educational Data Mining (EDM) conferences since 2008 and journal. o XIP Analysis All of the papers (66 LAK and 239 EDM papers 305 in total) were analysed using XIP, extracting 7847 sentences and 40163 concepts. o Paper Prototype Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
  • 21. o Similar patterns in LAK & EDM o Summary & Contrast categories higher & rising Visual Analytics of XIP Output http://bit.ly/DCLA13 Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
  • 22. Visual Analytics of XIP Output http://bit.ly/DCLA13 Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
  • 23. Visual Analytics of XIP Output http://bit.ly/DCLA13 Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
  • 24. Learning Analytics Potential? oA promising language technology oNow visual analytics built on top of it oWhat happens when we bring it into the realm of learning? Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
  • 25. S288 Practical Science o ~300 undergraduate students o 5 strands: o Physics and Astronomy o Chemistry and Analysis o Environmental Sciences o Earth and Environment o Biology and Health o Collaborative scientific writing assignment Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013 Learning Analytics Potential?
  • 26. Learning Analytics Potential? XIP Highlighted Student Essays Is the use of XIP’s rhetorical categories predictive of final grades? Student Grades Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013
  • 27. Learning Analytics Potential? What is the overlap between XIP’s output and how tutors judge quality? Tutor Highlighted Student Essays Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013 XIP Highlighted Student Essays
  • 28. Do learners find it helpful to receive formative feedback of this sort on their own writing, or of the literature? Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013 Learning Analytics Potential? C O L L A B O R A T I V E W R I T I N G E D I T O R
  • 29. Resources & Contact Details o Simsek, D., Buckingham Shum, S., Sándor, Á., De Liddo, A. and Ferguson, R. (2013). XIP Dashboard: Visual Analytics from Automated Rhetorical Parsing of Scientific Metadiscourse. 1st International Workshop on Discourse-Centric Learning Analytics. (3rd International Conference on Learning Analytics & Knowledge, 8 April 2013, Leuven, Belgium). http://bit.ly/DCLA13 o Taibi, D., Sándor, Á., Simsek, D., Buckingham Shum, S., De Liddo, A. and Ferguson, R. (2013) Visualizing the LAK/EDM Literature Using Combined Concept and Rhetorical Sentence Extraction, 1st Learning Analytics and Knowledge Data Challenge at Learning Analytics and Knowledge (LAK ’13), Leuven, Belgium http://bit.ly/DataChal o De Liddo, Anna; Sándor, Ágnes and Buckingham Shum, Simon (2012). Contested Collective Intelligence: rationale, technologies, and a human-machine annotation study. Computer Supported Cooperative Work (CSCW), 21(4-5) pp. 417–448. http://bit.ly/HumanVsXIP people.kmi.open.ac.uk/simsek duygu.simsek@open.ac.uk simsekduygu_ Learning Analytics Summer Institute (LASI), UK, Informatics Forum, Edinburgh July 5, 2013