SlideShare uma empresa Scribd logo
1 de 28
Baixar para ler offline
A Corpus Linguistics
Based Approach for
Estimating Arabic
Online Content
5,340,000
1,950,000
0.5 %
1%
1.4 %
3%
0.5 %
1.4 % %
     1
Zipff’s Law
Corpora
Building
Dmoz corpus
75,560 pages
530.1 MB
659,756 uniq. words
Wikipedia corpus
95,140 pages
213.3 MB
760,690 uniq. words
CCA corpus
377 pages
82,878 uniq. words
Common
‫‪Word‬‬   ‫‪Document‬‬   ‫‪Frequency‬‬   ‫‪Word‬‬       ‫‪Document‬‬   ‫‪Frequency‬‬

 ‫فً‬      ‫812,06‬   ‫882,770,1‬      ‫أو‬        ‫967,62‬    ‫457,501‬
 ‫من‬      ‫949,16‬    ‫250,068‬      ‫هذه‬        ‫982,92‬      ‫469,79‬
‫على‬      ‫648,65‬    ‫496,894‬      ‫بين‬        ‫266,23‬      ‫535,48‬
 ‫إلى‬     ‫995,84‬    ‫513,872‬      ‫اهلل‬       ‫308,62‬      ‫612,48‬
 ‫أن‬      ‫934,04‬    ‫564,772‬     ‫أخبار‬       ‫010,03‬      ‫498,18‬
‫عن‬       ‫637,05‬    ‫428,142‬      ‫كل‬         ‫772,03‬      ‫422,18‬
‫التً‬     ‫734,53‬    ‫200,661‬    ‫الزئيسية‬     ‫000,14‬      ‫161,08‬
 ‫ال‬      ‫221,04‬    ‫788,351‬      ‫بعد‬        ‫073,23‬      ‫713,87‬
 ‫مع‬      ‫797,83‬    ‫751,031‬    ‫الصفحة‬       ‫738,72‬      ‫449,66‬
 ‫ما‬      ‫736,33‬    ‫403,921‬       ‫لم‬        ‫304,52‬      ‫152,46‬
 ‫هذا‬     ‫363,13‬    ‫521,901‬      ‫كان‬        ‫613,32‬      ‫813,36‬
‫الذي‬     ‫474,23‬    ‫448,801‬     ‫العالم‬      ‫782,32‬      ‫864,06‬
A corpus linguistics based approach for estimating online content
A corpus linguistics based approach for estimating online content
A corpus linguistics based approach for estimating online content
A corpus linguistics based approach for estimating online content

Mais conteúdo relacionado

Mais de Anas Tawileh

Youth in Technology for Community Development
Youth in Technology for Community DevelopmentYouth in Technology for Community Development
Youth in Technology for Community DevelopmentAnas Tawileh
 
Global Digital Divide - at the HICSS 2010
Global Digital Divide - at the HICSS 2010Global Digital Divide - at the HICSS 2010
Global Digital Divide - at the HICSS 2010Anas Tawileh
 
Explaining the Digital Divide
Explaining the Digital DivideExplaining the Digital Divide
Explaining the Digital DivideAnas Tawileh
 
Case Study in Arabic English Web
Case Study in Arabic English WebCase Study in Arabic English Web
Case Study in Arabic English WebAnas Tawileh
 
Knowledge Production and Dissemination in the Digital Era
Knowledge Production and Dissemination in the Digital EraKnowledge Production and Dissemination in the Digital Era
Knowledge Production and Dissemination in the Digital EraAnas Tawileh
 
Sustainable Protection of Critical Corporate Information
Sustainable Protection of Critical Corporate InformationSustainable Protection of Critical Corporate Information
Sustainable Protection of Critical Corporate InformationAnas Tawileh
 
ISSE 2008 Information Security Status
ISSE 2008 Information Security StatusISSE 2008 Information Security Status
ISSE 2008 Information Security StatusAnas Tawileh
 

Mais de Anas Tawileh (8)

Youth in Technology for Community Development
Youth in Technology for Community DevelopmentYouth in Technology for Community Development
Youth in Technology for Community Development
 
Global Digital Divide - at the HICSS 2010
Global Digital Divide - at the HICSS 2010Global Digital Divide - at the HICSS 2010
Global Digital Divide - at the HICSS 2010
 
Explaining the Digital Divide
Explaining the Digital DivideExplaining the Digital Divide
Explaining the Digital Divide
 
Case Study in Arabic English Web
Case Study in Arabic English WebCase Study in Arabic English Web
Case Study in Arabic English Web
 
Knowledge Production and Dissemination in the Digital Era
Knowledge Production and Dissemination in the Digital EraKnowledge Production and Dissemination in the Digital Era
Knowledge Production and Dissemination in the Digital Era
 
Sustainable Protection of Critical Corporate Information
Sustainable Protection of Critical Corporate InformationSustainable Protection of Critical Corporate Information
Sustainable Protection of Critical Corporate Information
 
ISSE 2008 Information Security Status
ISSE 2008 Information Security StatusISSE 2008 Information Security Status
ISSE 2008 Information Security Status
 
Lasilky.org
Lasilky.orgLasilky.org
Lasilky.org
 

Último

The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality AssuranceInflectra
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Farhan Tariq
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch TuesdayIvanti
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPathCommunity
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfNeo4j
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfpanagenda
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rick Flair
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationKnoldus Inc.
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityIES VE
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Scott Andery
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Strongerpanagenda
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...Wes McKinney
 
Manual 508 Accessibility Compliance Audit
Manual 508 Accessibility Compliance AuditManual 508 Accessibility Compliance Audit
Manual 508 Accessibility Compliance AuditSkynet Technologies
 

Último (20)

The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch Tuesday
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to Hero
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdf
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog Presentation
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a reality
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
 
Manual 508 Accessibility Compliance Audit
Manual 508 Accessibility Compliance AuditManual 508 Accessibility Compliance Audit
Manual 508 Accessibility Compliance Audit
 

A corpus linguistics based approach for estimating online content

  • 1. A Corpus Linguistics Based Approach for Estimating Arabic Online Content
  • 2.
  • 3.
  • 7. 1%
  • 9. 3%
  • 10. 0.5 % 1.4 % % 1
  • 11.
  • 13.
  • 15.
  • 16. Dmoz corpus 75,560 pages 530.1 MB 659,756 uniq. words
  • 17. Wikipedia corpus 95,140 pages 213.3 MB 760,690 uniq. words
  • 19.
  • 20.
  • 22.
  • 23.
  • 24. ‫‪Word‬‬ ‫‪Document‬‬ ‫‪Frequency‬‬ ‫‪Word‬‬ ‫‪Document‬‬ ‫‪Frequency‬‬ ‫فً‬ ‫812,06‬ ‫882,770,1‬ ‫أو‬ ‫967,62‬ ‫457,501‬ ‫من‬ ‫949,16‬ ‫250,068‬ ‫هذه‬ ‫982,92‬ ‫469,79‬ ‫على‬ ‫648,65‬ ‫496,894‬ ‫بين‬ ‫266,23‬ ‫535,48‬ ‫إلى‬ ‫995,84‬ ‫513,872‬ ‫اهلل‬ ‫308,62‬ ‫612,48‬ ‫أن‬ ‫934,04‬ ‫564,772‬ ‫أخبار‬ ‫010,03‬ ‫498,18‬ ‫عن‬ ‫637,05‬ ‫428,142‬ ‫كل‬ ‫772,03‬ ‫422,18‬ ‫التً‬ ‫734,53‬ ‫200,661‬ ‫الزئيسية‬ ‫000,14‬ ‫161,08‬ ‫ال‬ ‫221,04‬ ‫788,351‬ ‫بعد‬ ‫073,23‬ ‫713,87‬ ‫مع‬ ‫797,83‬ ‫751,031‬ ‫الصفحة‬ ‫738,72‬ ‫449,66‬ ‫ما‬ ‫736,33‬ ‫403,921‬ ‫لم‬ ‫304,52‬ ‫152,46‬ ‫هذا‬ ‫363,13‬ ‫521,901‬ ‫كان‬ ‫613,32‬ ‫813,36‬ ‫الذي‬ ‫474,23‬ ‫448,801‬ ‫العالم‬ ‫782,32‬ ‫864,06‬